Did you go into labor early with your first? I have definitely read that you are suppose to drop late in your second and following pregnancies, but I wonder if that is a fact, or if it is just how it happens in most second pregnancies.
I hate sounding silly to my doctor too, but my DH always reminds me that they get paid good money (really good!) to deal with paranoid mom's like us!
So take advantage of your doc and give him a call. I doubt you will regret it!