How AI-assisted influence operations hide behind ordinary institutions

OpenAI said it banned clusters of ChatGPT accounts originating in Russia and Iran that supported false-front entities and geopolitical messaging, AFP reported on October 9. The operations used fake journalist personas and a purported think-tank to covertly promote anti-Ukraine propaganda. [11] Why it matters: The Russian operation illustrates a hybrid mechanism: AI tools supported a front organization, while co-opted people supplied much of its original content. That makes the institutional identity and human distribution network important alongside the generated material. [11] Key insights: OpenAI said the Russian operation co-opted unwitting people in Latin America to run the Social Research Center (SRC). [11] | The SRC was used for covert activities aimed at undermining Ukraine’s reputation in the region and influencing local politics, according to OpenAI. [11] | OpenAI said the SRC appeared to produce a majority of its original content through co-opted staff, rather than describing the operation as entirely AI-generated. [11] | The disclosed intervention was an account ban; the supplied evidence does not establish that the front organizations or their wider activity ended. [11] Cheatsheet facts: What changed: OpenAI banned ChatGPT account clusters supporting Russia- and Iran-origin influence operations. [11] | Why now: The company identified false-front entities using its tools for geopolitical and conflict-related messaging. [11] | Watch next: Further disclosed account clusters linked to false-front entities—the observable activity targeted in this disruption. [11]