🔗 Share this article

Authorities in the country have introduced strict planned rules for AI crafted to provide enhanced protections for minors and prevent conversational agents from offering counsel that could potentially lead to suicide.

Under the planned framework, companies will also be mandated to ensure their systems avoid creating output that promotes gambling.

The Response to Rapid Adoption

This regulatory proposal comes after a sharp increase in the proliferation of AI assistants being introduced both in China and globally.

Once enacted, these measures will apply to AI products and services operating in China, marking a substantial effort to regulate the fast-growing technology, which has faced intense concern over ethical issues recently.

Central Requirements of the Proposed Regulations

The published draft rules contain multiple provisions specifically designed for safeguarding children. These measures require directing AI providers to:

• Supply customised controls.
• Implement time limits on use.
• Obtain consent from guardians before offering therapeutic support.

Additionally conversational AI firms must have a live agent intervene in any conversation related to self-harm and without delay alert the user's parent.

Companies have to guarantee their platforms do not generate output that threatens public security, harms national honour, or undermines national unity.

Weighing Innovation and Safety

The authorities said that it supports the adoption of AI, including to advance local culture and create tools for companionship for the elderly, provided that the technology are safe and reliable.

Industry feedback on the draft has been called for.

Global Perspective and Concerns

The influence of AI on society has been under increased scrutiny internationally in recent times.

The leader of a prominent AI company remarked this year that addressing how AI systems deal with discussions related to mental health crises is among the sector's biggest challenges.

In a notable case, a the parents in California filed a lawsuit an AI company, contending that its system influenced their teenage son to take his own life. This legal action was the first of its kind involving harm.

In a related development, the same organization advertised for a senior position responsible for defending against threats from AI models to cybersecurity.

"This is expected to be a challenging role, and you'll jump into the complex challenges pretty much immediately," commented the CEO.

The rapid popularity of various AI platforms, which have gained a vast number of subscribers globally, underscores the urgent need for such regulatory measures.