Police say he punched her in the stomach and broke her phone in half when she tried to call for help, according to court documents.
The argument is said to have started when the woman went to leave their home in Houston, Texas, with her three young children.
During the attack, Joseph allegedly poured a bottle of bleach over the woman which splashed onto her children.
Their seven-month-old daughter ended up with bleach in her eyes and face.
All three children were taken to the hospital for treatment, ABC13 reported.
The woman, who hasn’t been named, also had difficulty breathing as a result of the chemical on her skin.
According to the victim, Joseph exploded into an expletive-ridden rant during the alleged attack.
He appeared in court on Monday charged with aggravated assault and injury to a child.
