OpenAI removes users in China, North Korea suspected of malicious activities

OpenAI has removed accounts in China and North Korea that were allegedly using its technology for malicious activities, including propaganda, surveillance, and fraud, the company said Friday.

In a report detailing the misuse, OpenAI said it used its artificial intelligence tools to detect and shut down the operations. The company did not disclose the number of accounts banned or the timeframe of the actions.

AI-generated propaganda and fraud

Among the banned accounts were Chinese users who used ChatGPT to generate Spanish-language news articles critical of the United States. The content was later published by Latin American media outlets under a Chinese company’s byline.

In another case, suspected North Korean actors used AI to create fake résumés and online profiles in an attempt to secure jobs at Western companies.

Additionally, OpenAI identified a Cambodia-based financial fraud operation that used ChatGPT to translate and generate content across platforms like X and Facebook.

U.S. concerns over AI exploitation

The U.S. government has raised alarms about China's alleged use of AI for domestic repression, misinformation, and efforts to undermine U.S. and allied security.

ChatGPT, the most widely used AI chatbot, has over 400 million weekly active users. OpenAI is currently in talks to raise up to $40 billion at a valuation of $300 billion, a potential record-setting funding round for a private company.