Beating AI News Flash: Thinking Machines co-founder and OpenAI co-founder John Schulman stated on the A16Z podcast that AI alignment should not be the exclusive research of a few tech companies, but should develop into a global public science, allowing more people to participate in shaping AI values and avoiding over-reliance on the judgment of a few companies.
As recursive self-improvement (RSI) gradually progresses, AI has begun to assist in model research and development. OpenAI Chief Research Officer Mark Chen revealed that early signals of RSI acceleration effects have appeared in the AI R&D process, with current progress at approximately 25% to 50%, but AI still struggles to independently identify valuable research directions and has not yet achieved independent development of next-generation models.
Mark Chen also warned that as model autonomy increases, if its goals are misaligned with human intent, long-running operation may produce unexpected secondary goals. However, more powerful AI is also expected to help researchers monitor model behavior, detect and fix alignment issues in turn.
John Schulman emphasized that AI alignment is not only a technical issue but also involves who decides the values AI should follow, and users and society should have more space to participate in and shape AI values.
