PM letter to Chris Fisher jokes he will have "more time for the Turnip Taliban and Norwich City with Ed Balls - enjoy"