The Deep View: Governance; the need for guardrails. Quote: ““The rule in the world has been that the smarter species control the stupid ones, and we’d be making ourselves the stupider ones in that scenario,” he said.”

Posted on October 27, 2025 by michelleclarke2015
Welcome back. OpenAI is making moves into AI music generation, positioning itself to compete directly with established players like Suno, a three-year-old startup that has already captured significant market share with its AI-powered music generator. OpenAI has been working with Juilliard students to annotate musical scores and develop the capability to generate music from text and audio prompts, similar to what Suno already offers its subscribers.
IN TODAY’S NEWSLETTER
1. Thousands call for superintelligence guardrails
2. Defense AI heats up
3. Snack giant Mondelez joins AI ad hype
 
GOVERNANCE

Thousands call for superintelligence guardrails

As tech leaders continue their frenzied pursuit of creating AI that’s better than us, some are calling to pump the brakes on development. The Future of Life Institute, a nonprofit dedicated to preventing “extreme large-scale risks” posed by technology, launched a petition on Wednesday dedicated to putting guardrails on the development of superintelligence, or AI that outperforms humans in every conceivable task. 

The petition, dubbed the “Statement on Superintelligence,” states that the development of superintelligence should be prohibited before there are calls for “broad scientific consensus” on how to do so safely and controllably. The petition has gained rapid momentum since its debut, with more than 45,000 signatures and counting. Its signatories include: Leading AI experts Geoffrey Hinton and Yoshua Bengio;Executives such as Virgin Group founder Sir Richard Branson and Apple co-founder Steve Wozniak; Political figures spanning the aisle, including former President of Ireland Mary Robinson, Duke and Duchess of Sussex Prince Harry and Meghan Markle, and former Trump Administration strategist Steve Bannon;And a host of entertainment industry figures, including Kate Bush, Grimes, Joseph Gordon-Levitt and Will.I.am.

“This statement was really conceived as a way to demonstrate the overwhelming and bipartisan majority of people who are extremely concerned about the current trajectory of advanced AI development,” Ben Cumming, communications director at the Future of Life Institute, told The Deep View. Polling by the organization released last week found that 73% of U.S. adults want robust AI regulation, and 64% believe superintelligence shouldn’t be developed until it’s proven safe.  Though AI leaders claim that the development of powerful AI and superintelligence will lead to a waterfall of breakthroughs that evolve humanity as a whole, the risks are numerous, said Cumming.

The tech’s possibilities could upend the economic landscape, supercharge disinformation, and muddy culture with the mass production of slop, he said. And while the petition calls for stricter guardrails, it’s hotly debated whether it will even be possible to control this tech at all, Cumming added. “The rule in the world has been that the smarter species control the stupid ones, and we’d be making ourselves the stupider ones in that scenario,” he said. Reaching Superintelligence would be a natural consequence of AGI, or AI that’s capable of matching human capabilities in every domain. The pursuit of this has led to a “frantic competition,” Cumming noted, where you’re either in the race or watching from the sidelines, safety and risk be damned. The problem, however, is that being in the race at all is incredibly costly –  hence why tech firms are pouring billions into compute. This has already concentrated incredible power in the hands of a select few, leading to a divide between the haves and the have-nots. That divide may only worsen over time as we inch towards increasingly powerful models.

Unknown's avatar

About michelleclarke2015

Life event that changes all: Horse riding accident in Zimbabwe in 1993, a fractured skull et al including bipolar anxiety, chronic fatigue …. co-morbidities (Nietzche 'He who has the reason why can deal with any how' details my health history from 1993 to date). 17th 2017 August operation for breast cancer (no indications just an appointment came from BreastCheck through the Post). Trinity College Dublin Business Economics and Social Studies (but no degree) 1997-2003; UCD 1997/1998 night classes) essays, projects, writings. Trinity Horizon Programme 1997/98 (Centre for Women Studies Trinity College Dublin/St. Patrick's Foundation (Professor McKeon) EU Horizon funded: research study of 15 women (I was one of this group and it became the cornerstone of my journey to now 2017) over 9 mth period diagnosed with depression and their reintegration into society, with special emphasis on work, arts, further education; Notes from time at Trinity Horizon Project 1997/98; Articles written for Irishhealth.com 2003/2004; St Patricks Foundation monthly lecture notes for a specific period in time; Selection of Poetry including poems written by people I know; Quotations 1998-2017; other writings mainly with theme of social justice under the heading Citizen Journalism Ireland. Letters written to friends about life in Zimbabwe; Family history including Michael Comyn KC, my grandfather, my grandmother's family, the O'Donnellan ffrench Blake-Forsters; Moral wrong: An acrimonious divorce but the real injustice was the Catholic Church granting an annulment – you can read it and make your own judgment, I have mine. Topics I have written about include annual Brain Awareness week, Mashonaland Irish Associataion in Zimbabwe, Suicide (a life sentence to those left behind); Nostalgia: Tara Hill, Co. Meath.
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a comment