Anglican Bishop Paul Yogusuk said that soldiers had attacked at least five women and girls in Kubi village, about 15 km southwest of the capital Juba.
Dozens of people were killed in heavy fighting after rebels said they would try to seize control of the town.
Only by listening to local LGBT activists in hostile environments can the West stand up for human rights worldwide.
Salva Kiir filled the vacant posts with people linked to a breakaway faction of Machar’s SPLM-IO party, further aggravating divisions between senior politicians in the oil producing nation.
Although a ceasefire was reached on July 11, the latest upsurge in fighting between rivals vice president Machar and President Kiir has left many South Sudanese angry and uncertain.
Recent fighting in South Sudan has raised fears of a return to the civil war that erupted in late 2013 and broadly ran along ethnic lines, pitting President Salva Kiir, an ethnic Dinka, against Vice President Riek Machar, a Nuer.
The US, UN Security Council and the Joint Monitoring and Evaluation Commission have voiced concern over the latest setback.