Members of the Economic Freedom Fighters stood their ground and refused to leave the National Assembly after being ordered to do so by Speaker Baleka Mbete on Thursday.
The EFF members disrupted proceedings while President Jacob Zuma was answering questions.
Mbete instructed EFF leader Julius Malema and his fellow MPs to leave the house because they were "not serious" about proceedings.
Malema was not happy with Zuma's reply to a question about when he was going to "pay back" part of the money spent on the R246 million security upgrades to his private Nkandla homestead in KwaZulu-Natal.
"I will throw you out of the house if you don't listen," Mbete shouted at EFF members, who responded by chanting "pay back the money".
Mbete eventually had to adjourn the House and call in security to help remove the EFF members.
While Zuma and MPs from other political parties left the chamber, EFF members remained, still chanting "pay back the money", and insisting they would not move.
EFF chief Whip Floyd Shivambu shouted at Mbete, "You won't remove us."