Your dad sounds like a real *******.
Does your mom know how he treats you, and that he verbally abuses you? If not, it is "crucial" that she is told. If she knows it's going on, and refuses to do anythign about it, she's no better.
It sounds like he really doesn't want any parts of you, no offense. Or maybe he's taking his anger out on you? I don't know. Seriously though, I would refuse to see him until he learns how to treat his you, his child.
If you're bound by court order to abide by visitation rights on his part, then you need to go to court or something and explain why you should not ever be put in that situation.
It sounds harsh, but what he is doing, is in fact abuse, even if it's not physical.
You have a right to be protected against that.