I take Verapamil, which is also a calcium channel blocker. I've been on CCB's for nearly 17 years, and have had very few problems with them.
The one thing I've found is that, if you've already got gastroesophageal reflux, the CCB's can make it worse. Other than that, no problems at all.