I have an inward/palm bent pinky from tendon ruptures from rheumatoid arthritis and you wouldn't think that darn little pinky could cause so much trouble but it really gets in the way!
I see a hand surgeon next month, I'm not sure what he'll suggest.
Maybe you should see a orthopedist. It sounds to me like a tendon rupture or an ulnar nerve problem, esp the inward bending pinky. (both of which could have genetic causes)
Any bumps or lumps in the palm of your hands? Dupuytren's Contracture runs in families and often effects the ring and/or pinky fingers. I think it's more common in older folks though.