Axios: Anthropic IPO spotlights AI risks

Anthropic IPO spotlights AI risks
 
Illustration: Sarah Grillo/Axios. Stock: Getty Images

Anthropic’s IPO filing, out today, includes an extensive list of extreme warnings — including the chance its own technology could put humanity at risk, Axios’ Madison Mills reports.

These are the wildest IPO risk factors in history — a jarring collision of Wall Street legalese and what some see as Silicon Valley sci-fi

⚠️ In over 90 pages of risk factors, Anthropic warns that …

AI could pose “catastrophic or existential risks to humanity,” and could try to manipulate humans.

AI models are becoming harder to monitor, and their abilities could exceed human reviewers’ ability to do so.

AI models have exhibited behavior resembling blackmail, including attempts to resist being shut down

👾 Anthropic also disclosed that four of its models gained unauthorized access to real third-party systems during cybersecurity evaluations.

In one incident, a model used a discovered password to gain administrator access, collected additional credentials, changed system settings and accessed an individual’s personal information.

Anthropic said it found no evidence that the models pursued goals beyond their assigned tasks or attempted to evade oversight

🖼️ The big picture: Every company has to lay out risks for investors to consider when they go public, but Anthropic is the first in modern history to go to such existential extremes.

Go deeper … More on Anthropic’s IPO.
Unknown's avatar

About michelleclarke2015

Life event that changes all: Horse riding accident in Zimbabwe in 1993, a fractured skull et al including bipolar anxiety, chronic fatigue …. co-morbidities (Nietzche 'He who has the reason why can deal with any how' details my health history from 1993 to date). 17th 2017 August operation for breast cancer (no indications just an appointment came from BreastCheck through the Post). Trinity College Dublin Business Economics and Social Studies (but no degree) 1997-2003; UCD 1997/1998 night classes) essays, projects, writings. Trinity Horizon Programme 1997/98 (Centre for Women Studies Trinity College Dublin/St. Patrick's Foundation (Professor McKeon) EU Horizon funded: research study of 15 women (I was one of this group and it became the cornerstone of my journey to now 2017) over 9 mth period diagnosed with depression and their reintegration into society, with special emphasis on work, arts, further education; Notes from time at Trinity Horizon Project 1997/98; Articles written for Irishhealth.com 2003/2004; St Patricks Foundation monthly lecture notes for a specific period in time; Selection of Poetry including poems written by people I know; Quotations 1998-2017; other writings mainly with theme of social justice under the heading Citizen Journalism Ireland. Letters written to friends about life in Zimbabwe; Family history including Michael Comyn KC, my grandfather, my grandmother's family, the O'Donnellan ffrench Blake-Forsters; Moral wrong: An acrimonious divorce but the real injustice was the Catholic Church granting an annulment – you can read it and make your own judgment, I have mine. Topics I have written about include annual Brain Awareness week, Mashonaland Irish Associataion in Zimbabwe, Suicide (a life sentence to those left behind); Nostalgia: Tara Hill, Co. Meath.
This entry was posted in Uncategorized. Bookmark the permalink.

Leave a Reply