Evaluation

1. Sep 28, 2026

   Keep review evidence separate from compacted agent context

   Independent Codex Guardian history shows why generation context and review evidence need separate records, with provenance through resume and rollback.

   Learning guides Agent engineering Memory & context Evaluation Security & privacy

   English
2. Sep 27, 2026

   Why old CLAUDE.md rules can hinder a model upgrade

   Use prompt audits, instruction layers, and migration evals to retain real requirements, reassess model workarounds, and enforce hard limits in code.

   Learning guides Agent engineering Evaluation Developer tools

   English
3. Sep 25, 2026

   Agent markets: 85% of the loss comes before negotiation

   Anthropic's book market experiment locates most efficiency loss in preference representation. A look at model choice, preference evals, and market rules.

   Technical articles Multi-agent systems Evaluation AI research

   English
4. Sep 25, 2026

   GitHub Security Lab makes fuzzing an agent feedback loop

   GitHub Security Lab Fuzzing Taskflow uses coverage gaps to guide model decisions while deterministic tools execute, measure, and persist results.

   Projects & practice Security & privacy Agent engineering Evaluation

   English
5. Sep 21, 2026

   A Minecraft agent separates planning from fast decisions

   This Minecraft agent uses Astra for slow planning, JEV for frequent action selection, and Mineflayer for execution, with logs and scripts to verify runs.

   Projects & practice Agents Agent engineering Evaluation

   English
6. Sep 21, 2026

   When to split a task across agents: check dependencies

   How task dependencies shape multi-agent results, with SAIGE experiments, ablations, and OpenAI guidance for deciding when to delegate.

   Learning guides Multi-agent systems Agent engineering Evaluation AI research

   English
7. Sep 20, 2026

   How to score a coding agent that finishes 80% but fails

   Android Bench 2.0 keeps pass rate as a hard gate and adds completion rate to diagnose progress and unfinished acceptance requirements.

   Technical articles Evaluation Developer tools AI research

   English
8. Sep 19, 2026

   Anthropic opens internal processes to embedded evaluators

   Anthropic and Accenture extend evaluation beyond model outputs to training, deployment, monitoring, and incident processes, with independence unresolved.

   Technical articles Evaluation Security & privacy AI research

   English
9. Sep 18, 2026

   skill-up: evaluate real stateful multi-turn sessions

   Alibaba skill-up resumes real sessions turn by turn, letting skill evaluations test context continuity, intermediate state, and per-turn assertions.

   Technical articles Evaluation MCP & skills Memory & context

   English
10. Sep 17, 2026

    Foreman: an independent supervisor for coding agents

    How Foreman separates a coding agent from supervision, using runtime evidence, Jev judgments, and deterministic policy to continue, verify, stop, or escalate.

    Projects & practice Agent engineering Evaluation Developer tools

    English
11. Sep 16, 2026

    Should an agent keep going or start a fresh attempt?

    Use When Agents Slow Down, Reflexion, Hyperband, and agent evaluation to compare continued revision with independent attempts under reproducible budgets.

    Learning guides Evaluation Memory & context AI research

    English
12. Sep 16, 2026

    Turn production agent failures into regression tests

    Use Kitaru Replay, Evaluator, and Regression Suite to preserve production failures as repeatable agent tests, with tool policies and CI gates.

    Learning guides Evaluation Agent engineering Developer tools

    English
13. Sep 14, 2026

    AWS agents propose; deterministic code validates

    How AWS separates agent proposals, rule checks, human approval, and execution, with code enforcing boundaries and idempotency.

    Technical articles Agent engineering Multi-agent systems Evaluation

    English
14. Sep 10, 2026

    Agentic search missed an incident. Test the eval too

    The Anthropic incident review shows why automated monitors and LLM graders need coverage, independence, and tests for their own failure modes.

    Technical articles Evaluation Security & privacy AI research

    English
15. Sep 9, 2026

    OpenAI agent workdays and shifting builder bottlenecks

    OpenAI organization-level data suggests that more coding-agent use shifts bottlenecks to task decomposition, concurrency, harnesses, evaluation, and selection.

    Technical articles Agents Agent engineering Evaluation

    English
16. Aug 2, 2026

    AI Engineering Harness: verifiable delivery for AI code

    A multi-agent engineering workflow uses isolated worktrees, CI, cold-start review, evidence gates, and layered context to control delivery of AI-generated code.

    Projects & practice Agent engineering Multi-agent systems Developer tools Evaluation

    English
17. Jun 16, 2026

    Loop Engineering Harness: controlling agent iterations

    Break down planning, execution, evaluation, state management, and stopping rules to keep multi-step agent tasks controlled and traceable.

    Learning guides Agent engineering Memory & context Evaluation

    English

No long-form articles match this language.