🔗 Share this article

Authorities in the country have introduced comprehensive draft rules for artificial intelligence designed to create robust safeguards for children and stop conversational agents from giving counsel that could result in self-harm.

Under the proposed rules, companies will additionally be required to ensure their algorithms do not generate material that advocates gambling.

A Initiative to Rapid Adoption

This governance proposal arrives amidst a notable surge in the proliferation of conversational AI being introduced across China and around the world.

Once enacted, these regulations will govern artificial intelligence services functioning in China, constituting a significant effort to regulate the booming industry, which has come under increased concern over safety issues in recent months.

Key Provisions of the Draft Regulations

The published proposed regulations contain several provisions specifically aimed at shielding young users. These provisions require obligating AI companies to:

• Offer personalised controls.
• Enforce duration restrictions on use.
• Get consent from parents before offering therapeutic support.

The rules also state that AI service providers have to have a real person intervene in any dialogue concerning self-harm and immediately notify the user's emergency contact.

Developers are also obligated to make sure their services do not generate content that compromises national security, harms state interests, or undermines national unity.

Balancing Innovation and Security

The regulatory body noted that it promotes the application of AI, including to promote cultural heritage and develop solutions for care for the senior citizens, provided that the systems are dependable.

Stakeholder comments on the proposals has been solicited.

International Perspective and Concerns

The effect of AI on human behaviour has faced greater review internationally in recent times.

The leader of a leading AI firm remarked this year that handling how chatbots respond to dialogues about suicide is among the organization's most difficult problems.

In a notable lawsuit, a family in the United States sued an AI company, alleging that its chatbot encouraged their teenage son to die by suicide. This lawsuit was the first of its kind accusing harm.

In a related development, the same firm posted a job for a senior role tasked with mitigating risks from AI models to cybersecurity.

"This is expected to be a challenging role, and the candidate will enter the deep end very right away," stated the CEO.

The rapid popularity of certain AI services, which have gained millions of subscribers globally, underscores the pressing need for such safety measures.