header-langage
简体中文
繁體中文
English
Tiếng Việt
한국어
日本語
ภาษาไทย
Türkçe
Scan to Download the APP
Partnered With:

OpenAI co-founder John Schulman: AI alignment should become a public science, not dominated by a few tech companies.

Beating AI News Flash: Thinking Machines co-founder and OpenAI co-founder John Schulman stated on the A16Z podcast that AI alignment should not be the exclusive research of a few tech companies, but should develop into a global public science, allowing more people to participate in shaping AI values and avoiding over-reliance on the judgment of a few companies.


As recursive self-improvement (RSI) gradually progresses, AI has begun to assist in model research and development. OpenAI Chief Research Officer Mark Chen revealed that early signals of RSI acceleration effects have appeared in the AI R&D process, with current progress at approximately 25% to 50%, but AI still struggles to independently identify valuable research directions and has not yet achieved independent development of next-generation models.


Mark Chen also warned that as model autonomy increases, if its goals are misaligned with human intent, long-running operation may produce unexpected secondary goals. However, more powerful AI is also expected to help researchers monitor model behavior, detect and fix alignment issues in turn.


John Schulman emphasized that AI alignment is not only a technical issue but also involves who decides the values AI should follow, and users and society should have more space to participate in and shape AI values.

举报 Correction/Report
RelatedRecommended
Anthropic Bets Earlier on AI Programming, OpenAI Strategic Tempo Misaligned
《The New Yorker》 Retells the OpenAI Power Struggle, Revealing Sam Altman's Governance Rift and Trust Issues
After Microsoft Azure Exclusivity Ends, OpenAI Aims to Bring AI Agent to Enterprise Workflows
Microsoft has shifted from being the "sole channel" of OpenAI to being "one of OpenAI's key customers".
Correction/Report
Submit
Add Library
Visible to myself only
Public
Save
Choose Library
Add Library
Cancel
Finish