Sam Altman revealed two ways he believes artificial intelligence can go ‘very badly’ as he called to slow the technology’s rapid progress.
Mr Altman, the CEO of ChatGPT maker OpenAI, shared his concerns in an X post late Sunday night following last week’s chilling warning from an AI whistleblower.
‘There are two ways AI could go very badly and that we must avoid,’ he posted on X.
‘First, we could lose control of the future of AI,’ an option Altman said is ‘unacceptable’.
‘We are unapologetically on Team Humanity and AI must always serve people,’ he declared. ‘To ensure that, we need to ensure that alignment and safety techniques stay ahead of progress in model capabilities.’
The other concern, Mr Altman said, is if we ‘end up in a world with too much concentration of power.
‘If an extraordinarily powerful AI is used by one person or company to impress their worldview onto everyone else, the results could be extremely dystopian.’
For these reasons, Mr Altman said he is cooperating with other executives to slow the progress on the rapidly evolving technology.
Sam Altman, CEO of OpenAI, revealed the two ways he sees the rapid progress on artificial intelligence ending ‘very badly’
Mr Altman has called for progress to slow down on the rapidly evolving technology
Jacob Coxon, a former researcher for OpenAI and Anthropic, the companies behind chatbots ChatGPT and Claude, joined Baier on Wednesday for a Special Report
‘When we talk about “pacing,” we don’t mean “stopping,”‘ he shared in an earlier post.
‘Progress has been rapid and will continue to be. But it should be slower than it otherwise could be,’ he said, noting that safety issues could come with serious costs.
‘Pacing will be well worth the cost,’ Altman then argued. ‘No amount of American competitive pressure should justify recklessness, or let capabilities get ahead of alignment and monitoring.’
‘The world deserves confidence that American companies developing increasingly capable AI will act responsibly, especially as the trajectory of progress has steepened,’ he added.
‘Every frontier lab must deliver on this, and there is no reason any of us should come to work if we cannot.’
Mr Altman’s plea comes after the resignation of whistleblower Jacob Coxon, who said that AI is posing an existential threat to humanity as he stepped away from his role with AI firm Anthropic.
Mr Coxon announced his departure in a social media post on Tuesday and warned that companies like Anthropic and OpenAI are not ‘acting responsibly’.
‘I resigned from Anthropic today,’ he wrote on X. ‘I spent the last three years doing pretraining research at both OpenAI and Anthropic.
‘Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives.’
Mr Coxon announced he quit the business through social media on Tuesday and warned that neither company is ‘acting responsibly’
Superintelligence is the point at which an artificial system becomes more powerful than any individual, company or even nation.
Mr Coxon continued to plead with the public on X. ‘Do not underestimate the power of this technology,’ he wrote.
‘These will soon be superhuman systems that can hack anything, revolutionize any field overnight, and acquire real power and resources.
‘We have all witnessed the progress in each of these domains, and progress is not slowing.
‘The people building AI earnestly believe that it could kill us all by the end of the decade. This is not a marketing stunt.’
He claimed that while executives and senior researchers ‘couch their phrasing in the press to sound sensible’, they are privately expressing similar concerns.
Geoffrey Hinton, a Canadian researcher often referred to as the ‘Godfather of AI’ – has similarly warned that super-intelligent systems could ‘lead to human extinction‘.
‘We would be very foolish to develop superintelligence now, when there is no scientific consensus it can be developed safely and controllably,’ Dr Hinton said.
‘Losing control over AI smarter than ourselves could be catastrophic and could even lead to human extinction.’
