Early on in my business, I once used the 'due to the complexity of your tax return' but it would grate on me ever to use that excuse again. 

Now to exorcise certain clients I may use  "I'm gradually downsizing my business and have to make the difficult decision to no longer provide tax preparation services to you.  Good luck."