🔗 Share this article

Regulators in the country have introduced strict planned guidelines for artificial intelligence designed to establish enhanced protections for children and prevent conversational agents from offering counsel that could result in violence.

As per the planned rules, developers will furthermore be obligated to ensure their systems do not generate material that encourages wagering.

A Response to Fast-Paced Growth

This oversight initiative arrives amidst a significant increase in the number of chatbots being launched across China and around the world.

Once approved, these measures will govern artificial intelligence services operating in China, constituting a major move to govern the fast-growing technology, which has been subject to intense concern over ethical concerns in recent months.

Central Measures of the Draft Rules

The released proposed regulations include multiple requirements particularly designed for protecting minors. These steps include mandating AI companies to:

• Provide customised settings.
• Set duration restrictions on usage.
• Secure permission from guardians before offering companionship services.

The rules also state that conversational AI firms are required to have a live agent assume control of any dialogue related to suicide and promptly inform the individual's emergency contact.

Companies have to make sure their services do not generate content that compromises state security, harms state interests, or undermines unity.

Balancing Development and Safety

The authorities said that it encourages the adoption of AI, for example to advance local culture and develop solutions for support for the elderly, on the condition that the systems are safe and reliable.

Stakeholder comments on the regulations has been requested.

Global Backdrop and Concerns

The effect of AI on human behaviour has come under heightened scrutiny around the world in recent months.

The leader of a prominent AI firm stated this year that handling how AI systems deal with conversations about self-harm is among the company's biggest issues.

In a high-profile lawsuit, a the parents in California filed a lawsuit an AI firm, claiming that its AI assistant influenced their 16-year-old son to take his own life. This lawsuit marked the pioneering of its kind alleging wrongful death.

Recently, the same firm posted a job for a key position responsible for defending against threats from AI systems to human mental health.

"The is expected to be a stressful job, and the candidate will enter the thick of it almost immediately," remarked the leader.

The meteoric popularity of certain AI platforms, which have attracted millions of users internationally, highlights the urgent need for such regulatory guidelines.