Leave! Please just leave! My experience is that name calling, using your words against you, threatening to divulge intimate conversations, withholding a child, using mental illness as a weapon ... are all ABUSE!
This isn't just verbal, it's emotional abuse.
Please do not bring a baby up in this environment. Pack up and go somewhere safe. You wont be lonely, you have your baby. Staying because you are scared of some lonely moment in your future, that may not happen, isn't a good reason. Your safety, and that of your baby are paramount. Don't give him the opportunity to escalate.
I have been here. I was scared. I was 43 with three kids. I am now in my fifties, in a good relationship. You can do this!