Did you deregister when you left?

I'm leaving at the end of the month, and today my accountant told me that to deregister they're going to expect me to pay all of 2009 and 2010 taxes before I do deregister. Gulp. I just paid off 2008 last week. Oh, and I'm unemployed...but they still want full tax money (oh, don't get me started...I'm married, but because my husband moved to the UK before me and isn't resident here, they're taxing me single which is about double the amount to pay if they taxed me as married....)