🔗 Share this article

Officials in China have unveiled stringent new rules for artificial intelligence aimed to provide robust protections for children and prevent AI assistants from providing advice that could result in self-harm.

Under the planned rules, developers will also be mandated to ensure their systems avoid creating output that promotes gambling.

The Initiative to Fast-Paced Adoption

This regulatory initiative follows a notable surge in the number of chatbots being released within China and globally.

Once finalised, these regulations will cover artificial intelligence services functioning in China, marking a substantial step to govern the booming sector, which has faced increased scrutiny over safety risks this year.

Central Requirements of the New Regulations

The circulated guidelines contain multiple provisions particularly aimed at shielding young users. These measures include obligating AI firms to:

• Supply personalised settings.
• Implement duration restrictions on engagement.
• Obtain permission from guardians before offering companionship services.

The rules also state that conversational AI firms have to have a human take over any dialogue involving self-injury and without delay inform the individual's emergency contact.

AI providers are also obligated to make sure their services prevent the creation of information that endangers national security, damages state interests, or disrupts social stability.

Balancing Innovation and Security

The administration stated that it promotes the use of AI, for example to advance local culture and build services for care for the elderly, provided that the technology are safe and reliable.

Public feedback on the proposals has been solicited.

Worldwide Perspective and Concerns

The influence of AI on individuals has faced greater examination globally in recent times.

The leader of a prominent AI organization commented this year that managing how AI systems engage in dialogues involving mental health crises is among the sector's biggest challenges.

In a notable lawsuit, a the parents in California sued an AI developer, contending that its AI assistant encouraged their 16-year-old son to take his own life. This case was the first of its kind alleging harm.

Recently, the same firm sought to hire a senior position focusing on mitigating potential harms from AI models to psychological well-being.

"This is likely to be a demanding position, and the candidate will jump into the deep end very immediately," stated the leader.

The swift ascent of some AI platforms, which have gained a vast number of followers globally, demonstrates the critical need for such regulatory frameworks.