I have heard that rheumatoid arthritis affects the joints closest to the hand. My pain and swelling is in the middle joints of my fingers, same fingers on both hands. Is this probably something else and I need not worry?

Yes, RA typically starts in the joints of the fingers. There is a specific blood test called RF- Rheumatoid Factor taht you could request from your doctor if you're concerned you might have RA.