header-langage
简体中文
繁體中文
English
Tiếng Việt
한국어
日本語
ภาษาไทย
Türkçe
Scan to Download the APP
Partnered With:

Writing Prompts are Inferior to Writing Loops: Solo Judge Runs Fable 5 Six Times Faster

According to Perceive Beating monitoring, a common pitfall targeting large models is overconfidence in self-correction. In a machine learning training challenge, the Anthropic team conducted a comparative test. Rather than allowing Fable 5 to engage in self-criticism, the experiment involved generating a scoring agent in an isolated context window through CMA's Outcomes feature, with a referee role based on a specification document containing 9 metrics.

The results indicate that the introduction of an independent referee in the iterative design allowed Fable 5 to achieve a 6x improvement in the training pipeline effectiveness compared to Opus 4.7. Fable 5 not only tends to explore significant architectural adjustments but also demonstrates strong engineering resilience by persisting in repairs even in the face of quantized setbacks. In contrast, Opus 4.7, due to decision-making constraints, remained in a conservative state of merely fine-tuning scalar constants according to templates.

In another investigation involving cross-session online learning in a database QA experiment, the team outlined a five-step approach for efficient memory utilization by large models. This approach involves recording failures, diagnosing causes, validating facts, distilling general rules, and directly retrieving rules using a shareable mounted file system.

Comparative tests revealed significant performance differences among various models. Sonnet 4.6 merely superficially records errors and engages in blind guessing, rarely referencing history. Opus 4.7 can establish pattern references with uncertain markers but achieves a validation coverage of only around 17%. Fable 5, on the other hand, can fully traverse the memory chain, achieving a validation coverage of 73% and summarizing diagnoses into general rules.

The experiment illustrates that designing a self-correcting loop responsive to feedback and autonomous memory management is more operationally valuable for large models than directly providing prompt words for guidance.

举报 Correction/Report
Correction/Report
Submit
Add Library
Visible to myself only
Public
Save
Choose Library
Add Library
Cancel
Finish