Agentic RL Daily

VOL. 043

8 research signals

DAILY EDITION / SAVED SNAPSHOT

Daily Signals: Thomson: Continual Learning of Frontier Models for SovereignAI

A dated Agentic RL Daily snapshot with 8 verified primary-source signals across papers, official releases, deployment evidence, and safety or alignment findings.

EDITOR'S VIEW

Three judgments

  1. Thomson: Continual Learning of Frontier Models for SovereignAI
  2. When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents
  3. OpenRLHF/OpenRLHF Release v0.11.0

FULL EDITION

All signals in this edition

Archived / 2026-08-30

01

Open SourceOpen Source

Thomson: Continual Learning of Frontier Models for SovereignAI

Thomson: Continual Learning of Frontier Models for SovereignAI

The development of frontier models is commonly perceived to be the exclusive remit of a small number of heavily funded players, creating an information, economic and power asymmetry between developers and the diverse user base of modern AI. Recent public discourse acknowledges this concern, calling

Agent Capabilities
arXiv ->

02

Open SourceOpen Source

When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents

When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents

Tool-augmented LLM agents must rely on untrusted runtime Observations to complete open-ended tasks; however, when tool outputs no longer merely provide data but begin to specify concrete actions, they effectively become ``commands'' that can drive real-world side effects beyond user intent. We argue

Training AlgorithmsAgent Capabilities
arXiv ->

03

IndustryIndustry

OpenRLHF/OpenRLHF Release v0.11.0

OpenRLHF/OpenRLHF Release v0.11.0

## What's Changed * Fix two latent bugs: dr_grpo n=1 guard and masked_normalize broadcast by @hijkzzz in https://github.com/OpenRLHF/OpenRLHF/pull/1250 * fix: allow eval_dataset with MultiTurnAgentExecutor (#1242) by @codewithyug06 in https://github.com/OpenRLHF/OpenRLHF/pull/1251 * Fix Qwen3.5 ZeRO

Training AlgorithmsAgent Capabilities
GitHub ->

04

Open SourceOpen Source

WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

WikiSkill: Compiling Agent Experience into Persistent Knowledge for Skill Evolution

Agent skills package specialized knowledge and workflows into reusable resources that extend AI agent capabilities. Recent work automatically discovers such skills from agent experience, which enables agents to progressively adapt through interaction. However, the insights that guide skill developme

Training AlgorithmsAgent Capabilities
arXiv ->

05

Open SourceOpen Source

Verify Smarter, Evolve Further: Efficient Harness Evolution through Behavior-Aware Verification

Verify Smarter, Evolve Further: Efficient Harness Evolution through Behavior-Aware Verification

Agent harnesses shape how language-model agents use instructions, tools, and runtime components, but adapting these harnesses requires costly verification. Existing propose-and-verify methods typically score every candidate on a fixed task set, wasting rollouts on unrelated behaviors and allowing ag

Training AlgorithmsAgent Capabilities
arXiv ->

06

Open SourceOpen Source

Naive Prompt Optimization: Rethinking the Need for Complex Prompt Search

Naive Prompt Optimization: Rethinking the Need for Complex Prompt Search

Efficiently improving autonomous agents across diverse tasks is central to accelerating recursive self-improvement (RSI) in agentic AI, with prompt optimization emerging as a promising approach capable of delivering performance gains comparable to those achieved by fine-tuning model weights, while r

Training AlgorithmsAgent Capabilities
arXiv ->

07

Open SourceOpen Source

What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents

What Makes Good Agentic Data? An ACE Lens on Data Generation for LLM Agents

LLM agents increasingly rely on generated interaction data to learn how to interact with external environments. Agentic data generation must maintain consistency among environments, tasks, interactions, and success signals while producing experience that is useful rather than merely abundant. Existi

Training AlgorithmsAgent Capabilities
arXiv ->

08

Open SourceOpen Source

SWE-Prime: Fewer Trajectories, Better Performance

SWE-Prime: Fewer Trajectories, Better Performance

官方来源补充信号:To improve large language models' ability to resolve real-world software issues, prior work has focused on constructing large-scale agent trajectory datasets and performing supervised fine-tuning (SFT) on successful trajectories. However, task success does not guarantee high-quality supervision: successful trajectories may still contain ineffective, redundant, or risky steps. Directly using such trajectories for SFT can introduce noisy supervision and encourage models to imitate undesirable problem-solving behaviors. Therefore, we propose SWE-Prime, a multi-granularity, two-stage SFT data sele

Agent CapabilitiesData Loops
arXiv ->