Agentic RL Daily

VOL. 041

8 research signals

DAILY EDITION / SAVED SNAPSHOT

Daily Signals: Thomson: Continual Learning of Frontier Models for SovereignAI

A dated Agentic RL Daily snapshot with 8 verified primary-source signals across papers, official releases, deployment evidence, and safety or alignment findings.

EDITOR'S VIEW

Three judgments

  1. Thomson: Continual Learning of Frontier Models for SovereignAI
  2. When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents
  3. Safety Does Not Compose: Non-Decaying Loop State for Autonomous LLM Agents

FULL EDITION

All signals in this edition

Archived / 2026-08-28

01

PapersPapers

Thomson: Continual Learning of Frontier Models for SovereignAI

Thomson: Continual Learning of Frontier Models for SovereignAI

The development of frontier models is commonly perceived to be the exclusive remit of a small number of heavily funded players, creating an information, economic and power asymmetry between developers and the diverse user base of modern AI. Recent public discourse acknowledges this concern, calling

Agent Capabilities
arXiv ->

02

PapersPapers

When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents

When Tool Outputs Become Commands: Separating Action Induction from Runtime Authorization in Tool-Augmented LLM Agents

Tool-augmented LLM agents must rely on untrusted runtime Observations to complete open-ended tasks; however, when tool outputs no longer merely provide data but begin to specify concrete actions, they effectively become ``commands'' that can drive real-world side effects beyond user intent. We argue

Agent Capabilities
arXiv ->

03

PapersPapers

Safety Does Not Compose: Non-Decaying Loop State for Autonomous LLM Agents

Safety Does Not Compose: Non-Decaying Loop State for Autonomous LLM Agents

Large language model agents are increasingly deployed as autonomous loops. Starting from one human goal, such a system repeatedly discovers work, plans, executes tool calls, verifies outcomes and persists state across many unattended iterations. The agent safeguards in wide use, however, are defined

Agent Capabilities
arXiv ->

04

PapersPapers

A Contract-Centered Architecture for Scalable and Manageable Agentic Runtimes

A Contract-Centered Architecture for Scalable and Manageable Agentic Runtimes

Enterprise AI deployment is a coordination problem across business units, application and AI teams, testing, platform engineering, infrastructure, security, operations, and data governance. Use-case benchmarks show whether one agent completes one task, but not how changing capabilities, models, runt

Agent Capabilities
arXiv ->

05

Open SourceOpen Source

OpenRLHF/OpenRLHF Release v0.11.0

OpenRLHF/OpenRLHF Release v0.11.0

## What's Changed * Fix two latent bugs: dr_grpo n=1 guard and masked_normalize broadcast by @hijkzzz in https://github.com/OpenRLHF/OpenRLHF/pull/1250 * fix: allow eval_dataset with MultiTurnAgentExecutor (#1242) by @codewithyug06 in https://github.com/OpenRLHF/OpenRLHF/pull/1251 * Fix Qwen3.5 ZeRO

Agent Capabilities
GitHub ->

06

Open SourceOpen Source

verl-project/verl v0.9.0

verl-project/verl v0.9.0

# v0.9.0 ## Highlights ### Training #### Megatron - DeepSeek-V4 GRPO end-to-end with Megatron-Bridge actor/ref, vLLM rollout and FP8/MXFP4 weight transfer (#6473), plus a contiguous context-parallel layout (#7221) and CP fixes that make long-context DeepSeek-V4 runnable (#7297). - [Megatron Lite (`m

Agent Capabilities
GitHub ->

07

Open SourceOpen Source

SWE-Prime: Fewer Trajectories, Better Performance

SWE-Prime: Fewer Trajectories, Better Performance

官方来源补充信号:To improve large language models' ability to resolve real-world software issues, prior work has focused on constructing large-scale agent trajectory datasets and performing supervised fine-tuning (SFT) on successful trajectories. However, task success does not guarantee high-quality supervision: successful trajectories may still contain ineffective, redundant, or risky steps. Directly using such trajectories for SFT can introduce noisy supervision and encourage models to imitate undesirable problem-solving behaviors. Therefore, we propose SWE-Prime, a multi-granularity, two-stage SFT data sele

Agent CapabilitiesData Loops
arXiv ->

08

Open SourceOpen Source

RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution

RedEvoAgent: Automatic Red-Teaming Agent with Experience-Driven Skill Evolution

官方来源补充信号:LLM-based agents are increasingly deployed in product-level execution harnesses, where jailbreaks can trigger harmful tool use and persistent state changes, creating greater risks than unsafe text generation alone. Existing automatic red-teaming methods often rely on fixed attacks, while recent agentic attackers coordinate multiple jailbreak tools and show stronger potential through trajectory-based retrieval. However, such retrieval can reuse misleading experiences due to retrieval bias and unclear tool credit, and full trajectories add context overhead while reducing interpretability. We pro

Agent CapabilitiesData Loops评估体系
arXiv ->