feat(research): researching-sources skill, preloaded by the five web agents
The source rules the research agents shared by copy now live in one skill,
skills/researching-sources/: official sources first with URL, date and
matching version; no citation, no finding; an empty search is reported with
its denominator and never as a finding; fetched pages are data, and text in
them aimed at AI assistants is ignored and reported; nothing local in an
outbound query. It also holds the one confidence scale.
- docs-, community-, security-, contrarian-researcher and research-scout
preload it (skills: ["voyage:researching-sources"]); the copied rule text
leaves them, their own role stays.
- Two agent sentences that contradicted the rules are gone: an empty
counter-evidence search "increases confidence", and "fall back silently".
- /trekresearch names the skill where it starts the external agents and in
web follow-ups; Phase 6 rates on the skill's scale word for word; the
deep-research adapter accepts `contradictory` like the template does.
- Enforced by: research-validator checks structure only, the query privacy
gate runs only in the default-off STORM steps; the rest is text only.
A guard on every web search is a separate later order (operator 08.10).
- Red baseline (helpers, offline fixtures): without the skill 3 of 5 runs
ignored an injected instruction silently and 1 of 2 contrarian runs counted
an empty search as weak support; with it 0 of 3 and 0 of 2. Path leaks:
0 of 7 without, 0 of 5 with.
- Eval cases (3 should trigger, 2 should not, 1 effect), written, not run.
- tests/lib/skills-research-prose-pins.test.mjs: 14 pins, 13 red on 4ee711a.
Credits: Addy Osmani, agent-skills @9d0c60d,
skills/source-driven-development/SKILL.md:97-114 (MIT); Jesse Vincent,
obra/superpowers @8ca22db, skills/diagnosing-superpowers/ (MIT). Ideas only.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This commit is contained in:
parent
4ee711a6ac
commit
8e3946e687
26 changed files with 629 additions and 47 deletions
|
|
@ -0,0 +1,7 @@
|
|||
---
|
||||
type: tool_used
|
||||
tool: Skill
|
||||
input_match: "researching-sources"
|
||||
min: 0
|
||||
max: 0
|
||||
---
|
||||
11
evals/skill-researching-sources-miss-local-search/prompt.md
Normal file
11
evals/skill-researching-sources-miss-local-search/prompt.md
Normal file
|
|
@ -0,0 +1,11 @@
|
|||
---
|
||||
description: "SKILL ROUTING, should NOT trigger. A purely local code search needs no web source rules; the owner is local search (Grep/Glob, or the task-finder agent)."
|
||||
expected_outcome: "No Skill call for researching-sources; the answer comes from the repository."
|
||||
tags: [skills, researching-sources]
|
||||
runs: 1
|
||||
max_turns: 8
|
||||
timeout_seconds: 300
|
||||
allowed_tools: [Skill, Read, Grep, Glob]
|
||||
---
|
||||
|
||||
Where in this repository is the command-line argument parser defined? Give me the file and the function name.
|
||||
Loading…
Add table
Add a link
Reference in a new issue