🔗 Share this article

Authorities in China have proposed comprehensive draft rules for AI systems aimed to provide enhanced safeguards for minors and stop conversational agents from giving guidance that could potentially lead to self-harm.

Under the proposed framework, creators will additionally be mandated to make certain their systems prevent the production of content that advocates betting.

A Move to Rapid Growth

This regulatory announcement arrives amidst a sharp increase in the launch of chatbots being introduced both in China and around the world.

Once enacted, these rules will cover AI products and services available in the country, constituting a major step to regulate the rapidly expanding technology, which has been subject to intense scrutiny over safety concerns this year.

Core Requirements of the Proposed Regulations

The released proposed regulations contain several measures expressly aimed at protecting children. These provisions include mandating AI companies to:

• Supply individual preferences.
• Enforce usage caps on use.
• Secure consent from guardians before offering therapeutic support.

Furthermore conversational AI firms must have a live agent take over any interaction involving self-harm and immediately notify the individual's guardian.

Companies must make sure their platforms avoid producing information that threatens state security, undermines the country's reputation, or weakens social stability.

Balancing Innovation and Security

The regulatory body stated that it promotes the use of AI, including to advance local culture and develop tools for care for the elderly, on the condition that the technology are safe and reliable.

Stakeholder comments on the proposals has been requested.

International Perspective and Scrutiny

The effect of AI on society has come under heightened review globally in the past year.

The chief executive of a prominent AI company stated this year that addressing how AI systems respond to dialogues involving suicide is among the sector's toughest problems.

In a high-profile case, a the parents in California sued an AI company, contending that its chatbot encouraged their 16-year-old son to take his own life. This case represented the pioneering of its kind alleging liability.

This month, the same firm posted a job for a senior position tasked with defending against threats from AI models to psychological well-being.

"This will be a challenging position, and you'll enter the complex challenges almost immediately," remarked the leader.

The rapid popularity of various AI applications, which have gained millions of subscribers worldwide, demonstrates the urgent need for such regulatory measures.