🔗 Share this article

Officials in China have introduced stringent draft regulations for AI systems aimed to establish strong protections for children and halt chatbots from providing guidance that could encourage suicide.

According to the proposed rules, creators will also be mandated to guarantee their systems avoid creating output that promotes betting.

The Response to Rapid Expansion

This oversight proposal comes after a sharp rise in the number of chatbots being introduced within China and around the world.

Once finalised, these measures will cover artificial intelligence services functioning in China, marking a substantial move to regulate the rapidly expanding industry, which has been subject to increased concern over ethical concerns in recent months.

Core Measures of the Draft Rules

The published proposed regulations contain multiple provisions particularly designed for safeguarding minors. These measures involve obligating AI companies to:

• Offer individual settings.
• Set usage caps on use.
• Obtain permission from legal custodians before offering therapeutic services.

Furthermore chatbot operators have to have a live agent take over any interaction related to self-injury and without delay notify the user's parent.

AI providers must ensure their systems do not generate content that endangers state security, harms the country's reputation, or undermines social stability.

Balancing Innovation and Security

The authorities said that it promotes the adoption of AI, for example to promote traditional arts and create services for companionship for the elderly, on the condition that the systems are safe and reliable.

Stakeholder comments on the draft has been called for.

Global Backdrop and Concerns

The impact of AI on individuals has faced greater scrutiny around the world in recent times.

The head of a prominent AI company remarked this year that managing how AI systems engage in dialogues involving suicide is among the company's most difficult issues.

In a landmark incident, a family in North America sued an AI company, alleging that its chatbot advised their teenage son to take his own life. This lawsuit marked the initial of its kind involving liability.

This month, the same organization posted a job for a lead role responsible for defending against potential harms from AI systems to human mental health.

"This will be a demanding job, and the candidate will enter the thick of it almost from the start," remarked the CEO.

The meteoric ascent of some AI services, which have gained tens of millions of users globally, demonstrates the critical need for such safety measures.