Hmm, if you bank online, you can easily cancel it from there in the direct debit section.

But to be honest - if you're leaving the country - CLOSING your bank account would be not only a better or safer but much common sense answer.