Well, if you do not go back on it, the withdrawal symptoms will continue as they are. If you can handle them currently, then it's your decision if you wish to tough it out. But tapering reduces the intensity of the symptoms or attacks, it just takes a while to taper down. And as a general rule of thumb, the slower you taper down, the more you reduce the withdrawals.
And I believe you're confusing withdrawals and addiction. Withdrawals are psychological or physiological symptoms your body goes through after a med has been taken away that has altered your body chemistry or function in some way. SSRIs inhibit or increase neurotransmitter activity in the central nervous system and brain. This is serious stuff. When you take it away, it's like shutting off an organ. The body has to readjust, hence withdrawals.
Addiction is when you become psychologically or physiologically dependant on a substance. If you stop taking it, your body craves it, like cigarettes or caffeine. Your mind convinces you that you cannot live without it. Weird stuff.
SSRIs are not addictive. Your body will not (or should not) crave them when you stop taking them. However, you will still have withdrawals because your body chemistry has changed.
Benzodiazepines, on the other hand, are highly addictive and you must fight both the addiction and the withdrawal symptoms if you stop taking those.