ResearchOpenAI

OpenAI bans Russian and Iranian influence accounts

Original title: Disrupting AI-enabled “false front” operations

Plain language

What it is: OpenAI banned accounts linked to two influence operations from Russia and Iran that used AI to spread geopolitical messages. These operations created fake journalists and a fake think tank to make their campaigns look real.
How it works: The operators used ChatGPT to write articles, draft social media comments, translate text, and write internal reports about their activities. They combined these AI tools with traditional methods like fake emails and VPNs.
Where it is available: This applies to ChatGPT accounts and OpenAI services, which the operators accessed using VPNs to bypass regional blocks.
Example: The Iranian operation used seven fake journalist personas to pitch articles to online media outlets and write social media comments about the United States and Iran war.

What it is: OpenAI disrupted two multi-dimensional influence operations originating from Russia and Iran that violated its usage policies. The actors utilized OpenAI models to facilitate workflows for false-front entities, including a fake think tank and fake journalist personas.
How it works: Threat actors used ChatGPT via VPNs to generate social media comments, draft internal reports, translate text, and create fake documents. The Russian operation also used the model to analyze public reporting on related military groups.
Where it is available: The disruption involved banning a cluster of ChatGPT accounts. The operations targeted external publications and social media platforms globally, particularly in Latin America.
Example: The Russian operation, named Dark Clark, used ChatGPT to draft progress reports for a fake think tank called the Social Research Center and to write internal reports on campaigns targeting Latin American politicians.

The headline and explanation on this page are based on OpenAI's post. The full details are in the original.

Disrupting AI-enabled “false front” operations