Hello Pinkbliss30 and welcome.
Please consider petitioning the courts for him to either have supervised visits with you present or at the very least a family member.
On the other hand,if seeing him is too overwhelming,then i'd consider the latter.
Since there is a history of abusive behavior,it won't be difficult to prove.
Remember that you have two people;you and your daughter,to protect here.