Two is not bad! When I caved in previous attempts I chain smoked for an hour. What made you cave? Stress? Hanging out with smoking friends? It was really hard for me in the first few weeks and has gotten easier as time goes on.
I had one when I was on a business trip a few weeks ago because I was at a bar and some of the people I was working with were smoking. I didn't like it much since I'm on the Chantix too. I wasn't really craving one but I'd read that you don't enjoy them much on the drug so I wanted to see and it turned out to be true for me.
Don't give up completely!