Technology and Science

Meta ‘supreme court’ takes on cases of deepfake porn

Meta’s oversight board said Tuesday it is scrutinizing the social media titan’s deepfake porn policies, through the lens of two cases.

The move by what is referred to as a Meta “supreme court” for content moderation disputes comes just months after the widespread sharing of lewd AI-generated images of megastar Taylor Swift on X, formerly Twitter.

The Meta board picked its two cases, regarding images shared on Instagram and Facebook, to “assess whether Meta’s policies and its enforcement practices are effective at addressing explicit AI-generated imagery,” it said in the release.

Advertisement

The board can make recommendations regarding the social media giant’s deepfake porn policies but it is up to the tech firm to actually make any changes.

The first case taken up by the Meta Oversight Board involves an AI-generated image of a nude woman posted on Instagram.

ALSO READ: Meta deploys new tools to combat sextortion on Instagram and other apps

Advertisement

The woman pictured resembled a public figure in India, sparking complaints from users in that country.

Meta left the image up, later saying it did so in error, the board said.

The second case involves a picture posted to a Facebook group devoted to AI creations.

Advertisement

That image depicted a nude woman resembling “an American public figure” with a man groping one of her breasts, the board said in a release.

The board did not name the woman, who it said was identified in a caption on the synthetic image at issue.

ALSO READ: Warning over Facebook Marketplace in SA after brothers murdered in Gqeberha

Advertisement

Meta removed the image for violating its harassment policy, and the user who posted the content appealed the decision, according to the board.

People were invited to submit comment, particularly on the gravity of harms posed by deepfake pornography and the harm it does to women who are public figures.

Deepfake porn images of celebrities are not new, but activists and regulators are worried that easy-to-use tools employing generative AI will create an uncontrollable flood of toxic or harmful content.

Advertisement

The targeting of Swift, one of the world’s top-streamed artists whose latest concert tour propelled her to the top of American fame, shined a spotlight on the phenomenon, with her legions of fans outraged at the development.

“It is alarming,” said White House Press Secretary Karine Jean-Pierre, when asked about the images at the time.

ALSO READ: TikTok the break-out star of social media in last five years

“Sadly we know that lack of enforcement (by the tech platforms) disproportionately impacts women and they also impact girls who are the overwhelming targets of online harassment,” Jean-Pierre added.

– By: © Agence France-Presse

For more news your way

Download our app and read this and other great stories on the move. Available for Android and iOS.

Published by
By Agence France Presse