In my teenaged years I didn't get much sleep and had a really bad sleeping pattern. Or also I had an injury when I was little. Could any of these reason be why "it" didn't grow?
anything could be the reason. most likely, though, it is not sleep, it is genetics. more than likely, your father, or your mother's father, or one of your ancestors had one much like yours.
I agree with tommy and at 20 you most likely are not finished growing. Groth and body changes continue till around 25 and some guy's even older.
So be happy with what you have and use it well and always be safe... (use a condom)
Keil