radiofree.asia

Stalkers are already depicting their victims in Open AI’s Sora 2 video generator

Journalist Taylor Lorenz has reported that her “stalker” is using the latest version of Open AI’s Sora to generate videos of her:


This is just one of the many criticisms people have for the generative video tool which is made by the same company that produces Chat GPT.

Stalking

Open AI launched Sora 2 on 1 October. As of right now, the video-creation service is invite-only.

As Lorenz notes, Sora 2 does at least have some measure of protection. In its safety document, Open AI write (emphasis added):

Consent-based likeness. Our goal is to place you in control of your likeness end-to-end with Sora. We have guardrails intended to ensure that your audio and image likeness are used with your consent, via cameos. Only you decide who can use your cameo, and you can revoke access at any time. We also take measures to block depictions of public figures (except those using the cameos feature, of course). Videos that include your cameo—including drafts created by other users—are always visible to you. This lets you easily review and delete (and, if needed, report) any videos featuring your cameo. We also apply extra safety guardrails to any video with a cameo, and you can even set preferences for how your cameo behaves—for example, requesting that it always wears a fedora.

The above text suggests there aren’t specific protections for non-public figures if their likeness is depicted outside of cameos. This aside, even if a non-public figure can effectively remove all videos containing their likeness from the Sora 2 video feed, they can’t do anything about videos which have been downloaded.

As users have highlighted, the cameo feature is heavily pushed, and will undoubtedly be difficult to track for anyone whose likeness goes viral:


Users have also highlighted how easy it is to put people into sexually suggestive situations using deceptive prompts:

The criticisms of Sora 2 and its user base don’t stop there:


As people have highlighted, generative AI is consuming ungodly amounts of electricity at a moment when we need to reduce emissions and before we’ve achieved a 100% rollout of renewable energy:


This is particularly problematic in America where Donald Trump is seeking to block renewable energy projects.

Where is this heading?

You may have noticed that the least creative people on the planet think they can compete with the Ghiblis and Tarantinos of the world now that they have access to Sora 2:


The truth is that people who lacked creativity in the past won’t suddenly produce works of great art now they can tell a machine to do it for them.

The artists, writers, musicians, and directors of the world got where they are through hard work and effort; there is no shortcut to honing these skills, and there is no magic wand to bestow talent.

For now the dullest minds on the internet seem happy with their slop and their revenge porn, but you can leave us out of it, thanks.

Featured image via Future in Review

By Willem Moore

This post was originally published on Canary.