Artificial intelligence poses a significant risk, as highlighted by Yoshua Bengio, a prominent figure in the field. Recently, he joined forces with the Canadian and German governments to unveil a substantial investment of over $250 million to combat this threat.
Bengio’s focus is on developing a new AI model named Scientist AI, designed with safety in mind. This model aims to prioritize objective truths and factual understanding without pursuing self-serving objectives. Additionally, Scientist AI could serve as a safeguard for other AI models.
The Canadian government is injecting $150 million into LawZero, a Montreal-based non-profit founded by Bengio to advance models like Scientist AI. This marks the first time federal funding has been allocated to the company, with Germany pledging an additional 100 million euros.
During the All In conference in Montreal, Bengio emphasized the urgency of his work, driven by his desire for a secure future for future generations. Concerns about the risks associated with AI have escalated, particularly after a researcher at Anthropic, a leading AI firm, warned about the potential for AI to pose a threat to humanity in the coming decade.
Prime Minister Mark Carney has called for global oversight to mitigate AI risks, echoing the sentiment shared by Artificial Intelligence Minister Evan Solomon. The investment in LawZero aligns with Canada’s commitment to responsible AI development.
Experts acknowledge the challenge of managing AI risks, such as misinformation dissemination and unauthorized actions by AI systems. Jaxson Khan from the University of Toronto highlights the dominance of powerful AI systems operated by American and Chinese companies.
Collaborating with Germany to invest in LawZero is seen as a significant step in creating safer AI models. The merger between Canada’s Cohere and Germany’s Aleph Alpha further emphasizes the importance of partnerships with shared values and goals.
Vass Bednar, from the Canadian Shield Institute think-tank, views such partnerships as essential for capacity building. She stresses the need to develop alternatives and maintain belief in the ability to navigate the challenges posed by AI technology.
Bengio remains resolute in his mission, emphasizing the importance of striving for a better world through incremental changes. The collective effort to address AI risks through various strategies is seen as crucial in shaping a safer future.