Kotzé, dubbed the "Modimolle Monster", was arrested on Wednesday. He had been on the run for a week since allegedly forcing three workers at gunpoint to gang-rape his wife and killing his 19-year-old stepson, Conrad Bonnette
As she was being raped, she could hear her son pleading for his life. Kotzé, however, killed him.
The ex-lover said: "I want to see how they bliksem him. He must be strung up by his pieletjie from a tree."
The other woman said several people will feel much safer now.
"I thought this morning [Wednesday] that everything should just come to an end."
Jonker de Vos, whose mom Sarita Venter from Bloemfontien, was also a Kotzé "victim" is just as relieved.
Venter committed suicide in 2010 after, according to her children, being financially and emotionally "destroyed" by Kotzé
"I just want him to rot in jail," said De Vos.
Sanee Williams, a Prieska businessman, said on Wednesday residents wanted the investigation into the death of Bet "Baba" Botha in 1993 reopened.
Kotzé was acquitted on a charge of murder following her death.
People who'd gone to the Modimolle police station to get a glimpse of the 50-year-old, vented their anger when he was taken to a doctor after being arrested.
"You must fucking burn in hell! You coward," shouted one.
Brigadier Hangwani Mulaudzi, spokesperson for the police in Limpopo, said Kotzé was dehydrated.
Kotzé, his head covered and wearing shorts, said nothing as he walked to the doctor.
"You [police] must give him to the farmers," said a bystander.
"I can't believe that he has the arrogance to walk down the street. The bliksem," said a family friend of the raped woman.