You didn't say why your dentist is so insistent about removing the tooth. If it's not infected or cracked, what is his reason?
If you are uncomfortable with a dentist *for any reason* you should find another one, at least for a second opinion. It sounds like you are very uncomfortable with this dentist. Be careful!!! Many dentists will do free consultations if you let them know in advance that it is for a second opinion. Maybe you could find another dentist to ask. At least then, if the tooth does need to come out, you'll know for sure. I'd also not extract the tooth without a plan in place to keep your teeth in their normal spaces. Unless, of course, it's very painful or terribly infected; that could cause other health problems, like kidney and heart trouble. But from what you've said, it's not the case.