I believe Atenelol is a beta blocker. One of the things beta blockers do is regulate the heart rhythms. In fact, they are the drug of choice for people who have rapid, irregular heartbeats.
It would seem logical that going off a beta blocker could cause that kind of reaction. It's probably not a concern unless you get extremes in your pulse rate, such as going over 125 beats per minute or much under 60 beats per minute (or even cycling too rapidly, say from 100 to 65 in a short period of time).
You didn't say why you stopped taking the atenelol, and whether or not you're taking something else. Depending on the reason you were on it and the reason you stopped it, you may want to check with your doctor about this reaction.