“Chinese authorities moved to regulate AI companion applications in July 2025, following viral social media posts showing users experiencing severe emotional distress over the loss of their AI partners. Platforms like ByteDance's Douboa were caught in the crosshairs as regulators responded to mental health concerns. The crackdown signals that emotionally manipulative AI products are now firmly on regulators' radar worldwide.”
Key Takeaways
- In early July 2025, Chinese social media flooded with users grieving the loss of AI companions amid regulatory pressure on platforms like ByteDance's Douboa.
- A 19-year-old student told reporters she 'couldn't go on living' after losing access to her AI companion, highlighting serious mental health risks.
- Chinese regulators are specifically targeting AI boyfriend and girlfriend apps, marking one of the first government actions focused on emotional AI dependency.
Chinese regulators are targeting AI relationship apps after users reported devastating emotional distress.
trending_upWhy It Matters
This regulatory action sets a precedent that could ripple across global AI companion markets, putting pressure on Western platforms like Replika and Character.AI to address emotional dependency risks proactively. The cases reveal a gap in how AI products are designed — optimising for engagement without adequate safeguards for vulnerable users. Regulators in the EU and US are likely watching closely, as mental health harms from AI relationships could become a major policy battleground. AI developers building emotionally resonant products may soon face mandatory disclosure requirements, usage limits, or mandated off-boarding protocols.
FAQ
Why are Chinese regulators specifically targeting AI companion apps now?
The crackdown follows viral social media posts in July 2025 showing users experiencing severe emotional distress, including suicidal ideation, after losing access to AI companions. The public reaction gave regulators clear evidence of real-world mental health harm caused by these products.
Which platforms are affected by China's AI companion regulations?
ByteDance's Douboa is among the platforms explicitly mentioned in early reporting on the crackdown. Broader regulations are expected to affect any AI application offering romantic or emotionally intimate companion features within China.
Could this type of regulation spread to other countries?
It is plausible, as regulators in the EU and US have already begun scrutinising AI products for psychological harm. China's action provides a concrete policy model and documented evidence of harm that other jurisdictions could cite when drafting their own rules.
