OpenAI restricts user portrayal of people in new AI video generator Sora
- OpenAI has officially released the AI video generator Sora, allowing users to create content through text prompts.
- The tool is intended to reduce costs in video production but raises concerns regarding potential misuse in generating deepfakes.
- OpenAI is taking a cautious approach by limiting human depiction capabilities in Sora while addressing ethical concerns.
In December 2023, OpenAI publicly launched its new artificial intelligence video generator, Sora, aimed at enhancing video content production. This tool allows users, particularly those subscribed to the premium version of ChatGPT, to create videos based on written commands effortlessly. Popular examples created using Sora include amusing and creative clips like bears wrestling and cats enjoying coffee. However, OpenAI has restricted the ability to generate videos depicting humans for most users amidst concerns regarding the potential misuse of the technology. OpenAI stated that only a select group of invited testers can create human-like videos while the organization addresses significant concerns linked to the misappropriation of likenesses and the rise of deepfakes. The company emphasized that it is taking proactive measures to block content related to nudity and prioritize preventing harmful content, which includes child sexual exploitation materials and sexual deepfakes. The debate surrounding such technologies has gained traction due to growing public awareness of their implications and consequences. The release of Sora was met with immense interest and traffic, which led OpenAI to temporarily suspend the creation of new user accounts shortly after the launch, indicating the significant demand for this AI tool. The company initially unveiled Sora earlier this year but opted to engage with artists, policymakers, and stakeholders before making the tool available to the wider public. OpenAI has not disclosed the specific visual and video sources used for training Sora, which has raised questions about possible copyright issues and ethical considerations in its development and deployment. Overall, while AI tools like Sora promise efficiency and creativity in video making, they also invoke worries about their potential for misuse, particularly in regards to manipulating images of real people. OpenAI's responsible approach to managing the tool's applications reflects a growing ethos in the tech industry to mitigate risks associated with advanced artificial intelligence technologies, as society navigates the complexities of innovation and ethics in digital content creation.