As long as the dad is responsible parent that takes well being and security of your son seriously then your son will benefit from having both parents in his life. They both can teach the child about life from different perspective and provide relationship that helps with emotional development. Also the dad has the right to have his son as part of his life given that he can fulfill his basic parenting responsibilities.
Can you have basic communication with your former partner about the needs of your child? Is he honest, trustworthy and reliable? Is he emotionally stable and provides safe environment for your child?
I think these are the important questions to ask and think about.