We’re teaming up with Thorn, All Tech Is Human, and other top companies to stop the wrong use of generative AI to cause, spread, and increase sexual harm to children.
OpenAI, along with major companies like Amazon, Anthropic, Civitai, Google, Meta, Metaphysic, Microsoft, Mistral AI, and Stability AI, has pledged to ensure strong child safety measures are integrated into the development, deployment, and upkeep of generative AI technologies, as outlined in the Safety by Design principles. This initiative, led by Thorn, a nonprofit dedicated to protecting children from sexual abuse, and All Tech Is Human, an organization addressing complex tech and societal issues, aims to reduce the risks generative AI poses to children.
By embracing comprehensive Safety by Design principles, OpenAI and its counterparts are making child safety a top priority at every stage of AI development. We’ve already taken significant steps to minimize the potential for our models to produce harmful content for children, such as setting age restrictions for ChatGPT and collaborating with organizations like the National Center for Missing and Exploited Children (NCMEC) and the Tech Coalition to enhance reporting mechanisms and address child protection concerns.
As part of our Safety by Design commitment, we pledge to:
- Develop generative AI models with proactive child safety measures.
- Responsibly source training data, detect and remove child sexual abuse material (CSAM) from datasets, and report any confirmed CSAM to authorities.
- Incorporate feedback loops and stress-testing strategies during development.
- Deploy solutions to address adversarial misuse.
- Release generative AI models only after rigorous evaluation for child safety.
- Combat abusive content and behaviors, and encourage developer accountability.
- Maintain ongoing model and platform safety efforts, including removing new instances of AI-generated CSAM.
- Invest in research and future technology to combat CSAM and other harmful content.
This commitment is a significant step in preventing the misuse of AI technologies to create or spread child sexual abuse material (AIG-CSAM) and other forms of harm against children. We are dedicated to working alongside Thorn, All Tech Is Human, and the wider tech community to uphold Safety by Design principles and continue our efforts to mitigate potential harm to children through responsible AI development and deployment.