Once they arrived at their home in South Africa, Mpungose allegedly hung his two youngest children, aged four and six in one bedroom and his son, aged 10, in another room.
Upon learning that the children had been taken from school by their father, Xolisile contacted police who escorted her to their family home.
When they arrived they discovered that the locks had been changed so police were forced to break down the door before discovering her three youngest children deceased.
Mpungose's stepdaughter and eldest child of Xolisile was found murdered in a forest nearby.
Appearing Pinetown's Magistrate's court last Friday, Mpungose is facing four counts of murder.
The case will resume on October 9.