If the Cymbalta wasn't working for you and it actually caused a physiological problem, it is the duty of your psych to change your meds and find something that does work for you. If this an issue that you have brought up and they disregarded it (as some in the medical profession are known to do), then you, as their employer, have every right to fire them. You pay them. They work for you. If they do not listen, hire someone else that will.
I wouldn't feel too guilty about spending money without getting any results. However, I would not discount finding another psychiatrist and therapist. If you have an anxiety disorder, it'll just go back to where it was before the Cymbalta (I know it's not that far).
So good luck and don't give up hope on all psychs. They are just like mechanics. There are a few that know what the heck they are doing, but most are just going through the motions.