Guyana is the latest Caribbean nation to crack down on forms of dressing deemed offensive.
Grenada caused raised eyebrows in January after police moved to warn young men against wearing baggy pants that reveal underwear.
In recent weeks Guyanese police have been arresting male cross-dressers.
Last month, a Guyana magistrate fined seven men GY$7,500 (US36dollars) for wearing "women's clothes", an offence under local law.
It also happens that the "wearing of female attire by men" is also forbidden.
Six local and international human and sexual rights organisations have voiced their protests against the arrests and fines.
'Violation of privacy'
They said they had written to President Bharrat Jagdeo, urging him to "end abuses against people on the grounds of their perceived sexual orientation or gender identity".
"These arrests, and the legal provisions which facilitate them, target people born male who wore what police regarded as female clothing," said the letter published on the website of the New York-based Human Rights Watch, one of the signatories.
"They constitute a violation of the individual's privacy, freedom of expression, and their personal dignity."
The signatories also include representatives of Global Rights, the International Gay and Lesbian Human Rights Commission, the Guyana Rainbow Foundation, the Society Against Sexual Orientation Discrimination and the Caribbean Forum for Liberation of Genders and Sexuality.
'Colonial relic'
Mr Jagdeo has not said whether his administration will cease the prosecutions but told reporters there was a need for public consultation on the issue.
He said: "Governments have to look at what people say, it doesn't mean you have to follow slavishly because you have to make sure the society advance in rights and other ways, making sure that people are not stigmatised too ..."
Reacting, Guyana sexuality rights activist Vidyaratha Kissoon insisted that the laws against cross-dressing contravened international conventions to which Guyana is a signatory.
He called the local regulations "relics of a colonial past".
Guyana's health minister, Leslie Ramsammy, told BBC Caribbean the issue of laws that impact on homosexuality was a sensitive matter for politicians in the region.
He said he didn't think the Caribbean public was ready for major changes in this area.