Is my ex hubby mentally retarted?

Sounds like he wants to give you a hard time. He doesn't seem to want to be a good father. Maybe your children are better off with no father than a bad one. If he is required to take the children for some time and he doesn't, maybe you can take him to court and get him to pay for a babysitter. Sorry to hear about your father ping.