
AI Security Briefing
This arXiv paper introduces SkillSec-Eval, a lifecycle-aware framework for evaluating the security of reusable LLM agent skills, covering stages beyond runtime execution: repository admission, semantic retrieval, planner selection, execution, and skill evolution. The authors build a threat taxonomy across this lifecycle and empirically evaluate it against a repository of 327 real-world agent skills, showing vulnerabilities exist at multiple stages that prior work (focused mainly on prompt injection and runtime execution) has largely ignored.
TL;DR A lifecycle-aware threat taxonomy and eval framework (SkillSec-Eval) finds security risks in agent skills beyond just prompt injection and execution, tested on 327 real-world skills.
Technologies named here
- SkillSec-Eval
- LLM
Techniques named here
- Repository admission
- Semantic retrieval
- Planner selection
- Execution
- Skill evolution
- Prompt Injection
Related in AI Security
