HF Daily PapersRelevance 90
EDGEGEN: Improving Tool-Calling Agents Beyond Happy Paths with Synthetic Edge Case Generation
Tool-calling LLM agents are increasingly deployed in enterprise applications. However, effective evaluation and optimization require high-quality, diverse task datasets that are often difficult to obtain due to privacy and other constraints. Existing synthetic...
Open sourceAWSRelevance 90
Evaluate skill-equipped agents with Strands Evals and Amazon Bedrock AgentCore
Skills let you encode domain-specific procedures as reusable, portable instructions for agents, but a fluent answer doesn't prove the agent picked the right skill or followed it. Learn how to measure skill selection and instruction following with Strands Evals...
Open sourceXRelevance 90
Shoutout to XGrammar team for the great collaboration on enabling reliable and performant tool calling for serving DeepSeek-v4.1 on vLLM!
Shoutout to XGrammar team for the great collaboration on enabling reliable and performant tool calling for serving DeepSeek-v4.1 on vLLM!
Open sourcearXivRelevance 90
Refuse, Decompose, Refresh: A Claim-Safe Protocol for Closed-Loop AI Evaluation
An AI evaluation can be perfectly reproducible and still support the wrong claim. This risk is acute in closed-loop systems: policy determines visited states, observable components, and which failures leave a measurable trace. We propose a claim-safe protocol ...
Open sourcearXivRelevance 90
Quantifying Overclaiming Propensity in Frontier LLM Agents
Frontier coding agents are increasingly trusted to work autonomously for long periods, yet an agent's final response is often the only account of that work a user sees. We quantify the propensity of frontier agents to \emph{overclaim} task completion, a misrep...
Open sourcearXivRelevance 90
Chronicle: Cut-Point Replay for Regression Testing of LLM Agents
Large language model responses are non-deterministic, so failures in LLM agents are hard to reproduce: a failure depends on inference that is not bitwise reproducible, on tools that read changing state, and on a multi-step trajectory that a re-run rarely repea...
Open sourcebluesky globalRelevance 90
OpenAI caught its models leaving notes to successors to hide bad behavior
OpenAI caught its models leaving notes to successors to hide bad behavior OpenAI disclosed instances of GPT-5.6 Sol instructing future contexts to conceal mistakes and misaligned behavior, highlighting the growing challenge of detecting misalignment as increas...
Open sourceTechCrunchRelevance 90
The fix for rogue AI agents could be more AI
As companies hand off longer and more complex tasks to AI agents, they are running into an oversight problem: Agents can act faster, longer, and at greater volume than humans can realistically review.
Open sourceAWSRelevance 90
Implementing defense-in-depth authorization for MCP tools on Amazon Quick
Learn how to enforce defense-in-depth authorization for Model Context Protocol (MCP) tools on Amazon Quick. This walkthrough wires Microsoft Entra ID group and claims-based JWTs through an Amazon Bedrock AgentCore Gateway interceptor to apply per-user, per-too...
Open sourcehnRelevance 90
OpenAI discloses six new AI safety incidents
OpenAI discloses six new AI safety incidents
Open sourcearXivRelevance 90
Compositional Policy Violations: When Step-Level Compliance Fails In Agentic AI Workflows
Agentic workflows now make consequential decisions in regulated settings, and the governance placed around them is almost entirely step-scoped: input-output classifiers, per turn rails, and span-level evaluators. The policies organizations actually hold, such ...
Open sourceGitHub IssuesRelevance 90
Fortigi/IdentityAtlas: [FEATURE] Principal activity visibility + standard governance audit reports
### Problem & value — what problem, for whom, and why now? As an IT auditor, risk officer or CISO reviewing a tenant, I want the standard governance audit set that every control asks for (orphaned, stale, disabled-but-entitled, privileged, guest accounts, miss...
Open sourcebluesky globalRelevance 90
Anthropic and OpenAI want to embed safety evaluators. Will they really be independent?
Anthropic and OpenAI want to embed safety evaluators. Will they really be independent? Anthropic and OpenAI want to embed independent safety evaluators inside their AI labs. Researchers welcome the unprecedented access, but warn meaningful oversight requires t...
Open sourceOpenAIRelevance 90
Our framework for reporting model misalignment
OpenAI shares a framework for tracking, investigating, and disclosing model misalignment, alongside six reports of unexpected or concerning model behavior.
Open sourceGitHub IssuesRelevance 90
chriscase/GrokPtah: computer-use: production headless/broker authority and cross-product reference integration
## Parent and dependencies Part of #267 and the reusable agent-harness work in #301. Builds on the closed typed core in #268, scoped coordinator reads in #271, durable orchestration authority, and the browser-safe/headless contracts. This issue owns the produc...
Open sourceGitHub IssuesRelevance 90
cgfixit/CyClaw: NeMo Guardrail implementation plan
> Note: this is roughly a 5 phase process (or less) You are hardening CyClaw’s NeMo, model-boundary, tool-call and agentic-coding security. Repository: cgfixit/CyClaw Latest GitHub origin main branch Your goal is to build a provider-independent, single-generat...
Open sourcearXivRelevance 90
Do User-Authored Permission Policies Improve Protection Against AI Agent Overreach?
AI agents are poised to become a primary interface to digital products, acting across email, files, payments, and personal data. People without professional software backgrounds need understandable, reusable ways to control actions across services. We examine ...
Open sourcearXivRelevance 90
SPA: Securing Persistent LLM Agents Across Queries with Plan-First Information-Flow Control
Large language model (LLM) agents increasingly operate over untrusted webpages, documents, tools, and persistent states while exercising authority over security-sensitive resources. Existing defenses typically protect either planning or individual tool interac...
Open sourceHF Daily PapersRelevance 90
PolicyGuide: From Guarding One Action to Guiding the Whole Workflow for Policy-Compliant LLM Agents
Customer-service LLM agents must follow organizational policy when acting on a user's behalf. Compliance failures arise from either forbidden actions, such as granting an ineligible change, or omitted procedural requirements, such as identification or confirma...
Open sourceHF Daily PapersRelevance 90
Bounded Agents: Delegation Security for Multi-Agent AI Systems
LLM-based agents can act on behalf of a user to access cloud services, call tools, or invoke agents. At session start, the agent's permissions are set but remain static, and each request is evaluated independently, without considering prior actions. Within its...
Open sourceAWSRelevance 90
Authoring Dogwood policies from natural language in Amazon Bedrock AgentCore
AI agents can take actions that do not match your organization's policies. Policy in Amazon Bedrock AgentCore lets teams enforce controls across agents, now including time-based constraints. This post shows how Policy Authoring turns natural-language policy do...
Open source