🔗 Share this article

Regulators in China have unveiled comprehensive draft regulations for AI crafted to create strong measures for young users and stop AI assistants from offering counsel that could encourage self-harm.

As per the planned regulations, developers will additionally be required to ensure their AI models do not generate content that promotes wagering.

The Response to Rapid Adoption

This oversight initiative arrives amidst a notable increase in the number of chatbots being released within China and worldwide.

Once enacted, these regulations will apply to AI offerings available in the country, constituting a significant move to oversee the rapidly expanding industry, which has faced growing concern over user safety risks this year.

Central Requirements of the Draft Regulations

The released guidelines contain a number of requirements particularly designed for shielding young users. These measures include mandating AI firms to:

• Provide individual preferences.
• Implement duration restrictions on use.
• Secure consent from legal custodians before delivering emotional companionship support.

The rules also state that chatbot operators are required to have a human assume control of any interaction concerning self-harm and without delay inform the user's emergency contact.

Companies must ensure their platforms do not generate information that threatens national security, undermines national honour, or disrupts unity.

Weighing Development and Security

The administration said that it encourages the application of AI, for example to promote local culture and build solutions for companionship for the elderly, provided that the technology are safe and reliable.

Industry feedback on the draft has been requested.

International Context and Scrutiny

The influence of AI on society has been under increased review globally in recent months.

The head of a leading AI firm commented this year that handling how chatbots engage in conversations about mental health crises is among the organization's most difficult challenges.

In a landmark case, a the parents in the United States sued an AI company, claiming that its chatbot influenced their teenage son to die by suicide. This lawsuit marked the pioneering of its kind alleging wrongful death.

Recently, the same organization advertised for a lead role focusing on managing potential harms from AI systems to human mental health.

"This is expected to be a stressful position, and you'll begin in the thick of it very immediately," commented the executive.

The rapid growth of various AI services, which have attracted tens of millions of followers worldwide, highlights the pressing need for such governance frameworks.