社交媒体作者呼吁国会禁止AI递归自我改进

Every AI company is trying to fully automate AI research; to allow the AIs to build the next AI. This is called Recursive Self Improvement (RSI). OpenAI says they are on track to do so by March 2028. Anthropic employees say they are on track to do so by 2027. The METR report below suggests they are likely right. This is a bad idea given current technology. Any mistake or misalignment in current AIs could be multiplied in each generation. We don't get another election before AI companies reach this threshold. Congress should ban RSI, this year if possible. This is a remarkably consensus opinion, supported in various versions by: -Bernie Sanders -Steve Bannon -Ralph Nader -Glenn Beck -Republican and Democratic attorneys general -Whistleblower Daniel Kokotajlo -Turing Award winner Yoshua Bengio -Humans First -Open Markets Institute -Ezra Klein -Arvind Narayanan (a Princeton computer scientist known for arguing that “AI is a normal technology”) The exact mechanism can be debated. The ban doesn't have to be permanent either (see below for both). This is not the only thing we have to do in regards to AI, far from it! But it is urgent. Congress must ban RSI.

Since August, a team within METR has worked with internal Anthropic information to assess whether AI itself is accelerating AI development. We are now publishing a report summarizing the results of this risk assessment.