The men aged between 32 and 34, were caught at around 2am, Captain Mali Govender said.
Police recovered two firearms, two magazines and 23 rounds of ammunition.
A case of possession of unlicensed firearm and ammunition was opened.
In a separate incident, a man was under heavy police guard at a hospital in Grahamstown after he was brought in with several gun shot wounds.
Govender said the man was brought to the hospital on Thursday and a police investigation discovered that he was wanted for a crime he committed in Port Elizabeth.