Skill · em Automatizar e estender

skill-creator

Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better…

Procedência

Antes de instalar

18 arquivos · 219,7 KB · inclui 10 scripts que executam: eval-viewer/generate_review.py, scripts/__init__.py, scripts/aggregate_benchmark.py, scripts/generate_report.py, scripts/improve_description.py, scripts/package_skill.py, scripts/quick_validate.py, scripts/run_eval.py, scripts/run_loop.py, scripts/utils.py

Instalar na sua CLI

O comando baixa a versão fixada (commit 3337550) direto da origem, para a pasta que a CLI lê. Precisa de curl (macOS e Linux); no Windows não há comando, porque o Rook Labs é para macOS.

Claude Code

Neste projeto: instala em .claude/skills/skill-creator/.

d=".claude/skills/skill-creator"
u="https://raw.githubusercontent.com/anthropics/skills/33375500bcea98d610eb30ce10ac4e59b89c390d/skills/skill-creator"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/agents/analyzer.md" "$u/agents/analyzer.md" \
  -o "$d/agents/comparator.md" "$u/agents/comparator.md" \
  -o "$d/agents/grader.md" "$u/agents/grader.md" \
  -o "$d/assets/eval_review.html" "$u/assets/eval_review.html" \
  -o "$d/eval-viewer/generate_review.py" "$u/eval-viewer/generate_review.py" \
  -o "$d/eval-viewer/viewer.html" "$u/eval-viewer/viewer.html" \
  -o "$d/LICENSE.txt" "$u/LICENSE.txt" \
  -o "$d/references/schemas.md" "$u/references/schemas.md" \
  -o "$d/scripts/__init__.py" "$u/scripts/__init__.py" \
  -o "$d/scripts/aggregate_benchmark.py" "$u/scripts/aggregate_benchmark.py" \
  -o "$d/scripts/generate_report.py" "$u/scripts/generate_report.py" \
  -o "$d/scripts/improve_description.py" "$u/scripts/improve_description.py" \
  -o "$d/scripts/package_skill.py" "$u/scripts/package_skill.py" \
  -o "$d/scripts/quick_validate.py" "$u/scripts/quick_validate.py" \
  -o "$d/scripts/run_eval.py" "$u/scripts/run_eval.py" \
  -o "$d/scripts/run_loop.py" "$u/scripts/run_loop.py" \
  -o "$d/scripts/utils.py" "$u/scripts/utils.py"

Global: instala em ~/.claude/skills/skill-creator/.

d="$HOME/.claude/skills/skill-creator"
u="https://raw.githubusercontent.com/anthropics/skills/33375500bcea98d610eb30ce10ac4e59b89c390d/skills/skill-creator"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/agents/analyzer.md" "$u/agents/analyzer.md" \
  -o "$d/agents/comparator.md" "$u/agents/comparator.md" \
  -o "$d/agents/grader.md" "$u/agents/grader.md" \
  -o "$d/assets/eval_review.html" "$u/assets/eval_review.html" \
  -o "$d/eval-viewer/generate_review.py" "$u/eval-viewer/generate_review.py" \
  -o "$d/eval-viewer/viewer.html" "$u/eval-viewer/viewer.html" \
  -o "$d/LICENSE.txt" "$u/LICENSE.txt" \
  -o "$d/references/schemas.md" "$u/references/schemas.md" \
  -o "$d/scripts/__init__.py" "$u/scripts/__init__.py" \
  -o "$d/scripts/aggregate_benchmark.py" "$u/scripts/aggregate_benchmark.py" \
  -o "$d/scripts/generate_report.py" "$u/scripts/generate_report.py" \
  -o "$d/scripts/improve_description.py" "$u/scripts/improve_description.py" \
  -o "$d/scripts/package_skill.py" "$u/scripts/package_skill.py" \
  -o "$d/scripts/quick_validate.py" "$u/scripts/quick_validate.py" \
  -o "$d/scripts/run_eval.py" "$u/scripts/run_eval.py" \
  -o "$d/scripts/run_loop.py" "$u/scripts/run_loop.py" \
  -o "$d/scripts/utils.py" "$u/scripts/utils.py"

Codex

Neste projeto: instala em .agents/skills/skill-creator/.

d=".agents/skills/skill-creator"
u="https://raw.githubusercontent.com/anthropics/skills/33375500bcea98d610eb30ce10ac4e59b89c390d/skills/skill-creator"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/agents/analyzer.md" "$u/agents/analyzer.md" \
  -o "$d/agents/comparator.md" "$u/agents/comparator.md" \
  -o "$d/agents/grader.md" "$u/agents/grader.md" \
  -o "$d/assets/eval_review.html" "$u/assets/eval_review.html" \
  -o "$d/eval-viewer/generate_review.py" "$u/eval-viewer/generate_review.py" \
  -o "$d/eval-viewer/viewer.html" "$u/eval-viewer/viewer.html" \
  -o "$d/LICENSE.txt" "$u/LICENSE.txt" \
  -o "$d/references/schemas.md" "$u/references/schemas.md" \
  -o "$d/scripts/__init__.py" "$u/scripts/__init__.py" \
  -o "$d/scripts/aggregate_benchmark.py" "$u/scripts/aggregate_benchmark.py" \
  -o "$d/scripts/generate_report.py" "$u/scripts/generate_report.py" \
  -o "$d/scripts/improve_description.py" "$u/scripts/improve_description.py" \
  -o "$d/scripts/package_skill.py" "$u/scripts/package_skill.py" \
  -o "$d/scripts/quick_validate.py" "$u/scripts/quick_validate.py" \
  -o "$d/scripts/run_eval.py" "$u/scripts/run_eval.py" \
  -o "$d/scripts/run_loop.py" "$u/scripts/run_loop.py" \
  -o "$d/scripts/utils.py" "$u/scripts/utils.py"

Global: instala em ~/.agents/skills/skill-creator/.

d="$HOME/.agents/skills/skill-creator"
u="https://raw.githubusercontent.com/anthropics/skills/33375500bcea98d610eb30ce10ac4e59b89c390d/skills/skill-creator"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/agents/analyzer.md" "$u/agents/analyzer.md" \
  -o "$d/agents/comparator.md" "$u/agents/comparator.md" \
  -o "$d/agents/grader.md" "$u/agents/grader.md" \
  -o "$d/assets/eval_review.html" "$u/assets/eval_review.html" \
  -o "$d/eval-viewer/generate_review.py" "$u/eval-viewer/generate_review.py" \
  -o "$d/eval-viewer/viewer.html" "$u/eval-viewer/viewer.html" \
  -o "$d/LICENSE.txt" "$u/LICENSE.txt" \
  -o "$d/references/schemas.md" "$u/references/schemas.md" \
  -o "$d/scripts/__init__.py" "$u/scripts/__init__.py" \
  -o "$d/scripts/aggregate_benchmark.py" "$u/scripts/aggregate_benchmark.py" \
  -o "$d/scripts/generate_report.py" "$u/scripts/generate_report.py" \
  -o "$d/scripts/improve_description.py" "$u/scripts/improve_description.py" \
  -o "$d/scripts/package_skill.py" "$u/scripts/package_skill.py" \
  -o "$d/scripts/quick_validate.py" "$u/scripts/quick_validate.py" \
  -o "$d/scripts/run_eval.py" "$u/scripts/run_eval.py" \
  -o "$d/scripts/run_loop.py" "$u/scripts/run_loop.py" \
  -o "$d/scripts/utils.py" "$u/scripts/utils.py"

Antigravity

Neste projeto: instala em .agents/skills/skill-creator/.

d=".agents/skills/skill-creator"
u="https://raw.githubusercontent.com/anthropics/skills/33375500bcea98d610eb30ce10ac4e59b89c390d/skills/skill-creator"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/agents/analyzer.md" "$u/agents/analyzer.md" \
  -o "$d/agents/comparator.md" "$u/agents/comparator.md" \
  -o "$d/agents/grader.md" "$u/agents/grader.md" \
  -o "$d/assets/eval_review.html" "$u/assets/eval_review.html" \
  -o "$d/eval-viewer/generate_review.py" "$u/eval-viewer/generate_review.py" \
  -o "$d/eval-viewer/viewer.html" "$u/eval-viewer/viewer.html" \
  -o "$d/LICENSE.txt" "$u/LICENSE.txt" \
  -o "$d/references/schemas.md" "$u/references/schemas.md" \
  -o "$d/scripts/__init__.py" "$u/scripts/__init__.py" \
  -o "$d/scripts/aggregate_benchmark.py" "$u/scripts/aggregate_benchmark.py" \
  -o "$d/scripts/generate_report.py" "$u/scripts/generate_report.py" \
  -o "$d/scripts/improve_description.py" "$u/scripts/improve_description.py" \
  -o "$d/scripts/package_skill.py" "$u/scripts/package_skill.py" \
  -o "$d/scripts/quick_validate.py" "$u/scripts/quick_validate.py" \
  -o "$d/scripts/run_eval.py" "$u/scripts/run_eval.py" \
  -o "$d/scripts/run_loop.py" "$u/scripts/run_loop.py" \
  -o "$d/scripts/utils.py" "$u/scripts/utils.py"

Global: instala em ~/.gemini/antigravity-cli/skills/skill-creator/.

d="$HOME/.gemini/antigravity-cli/skills/skill-creator"
u="https://raw.githubusercontent.com/anthropics/skills/33375500bcea98d610eb30ce10ac4e59b89c390d/skills/skill-creator"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/agents/analyzer.md" "$u/agents/analyzer.md" \
  -o "$d/agents/comparator.md" "$u/agents/comparator.md" \
  -o "$d/agents/grader.md" "$u/agents/grader.md" \
  -o "$d/assets/eval_review.html" "$u/assets/eval_review.html" \
  -o "$d/eval-viewer/generate_review.py" "$u/eval-viewer/generate_review.py" \
  -o "$d/eval-viewer/viewer.html" "$u/eval-viewer/viewer.html" \
  -o "$d/LICENSE.txt" "$u/LICENSE.txt" \
  -o "$d/references/schemas.md" "$u/references/schemas.md" \
  -o "$d/scripts/__init__.py" "$u/scripts/__init__.py" \
  -o "$d/scripts/aggregate_benchmark.py" "$u/scripts/aggregate_benchmark.py" \
  -o "$d/scripts/generate_report.py" "$u/scripts/generate_report.py" \
  -o "$d/scripts/improve_description.py" "$u/scripts/improve_description.py" \
  -o "$d/scripts/package_skill.py" "$u/scripts/package_skill.py" \
  -o "$d/scripts/quick_validate.py" "$u/scripts/quick_validate.py" \
  -o "$d/scripts/run_eval.py" "$u/scripts/run_eval.py" \
  -o "$d/scripts/run_loop.py" "$u/scripts/run_loop.py" \
  -o "$d/scripts/utils.py" "$u/scripts/utils.py"

Peça ao Rook

Já usa o Rook Labs? Cole no chat do Rook: instale a skill https://rooklabs.sh/marketplace/anthropic.skill-creator

Prévia do SKILL.md

---
name: skill-creator
description: Create new skills, modify and improve existing skills, and measure skill performance. Use when users want to create a skill from scratch, edit, or optimize an existing skill, run evals to test a skill, benchmark skill performance with variance analysis, or optimize a skill's description for better triggeri…
---

# Skill Creator

A skill for creating new skills and iteratively improving them.

At a high level, the process of creating a skill goes like this:

- Decide what you want the skill to do and roughly how it should do it
- Write a draft of the skill
- Create a few test prompts and run claude-with-access-to-the-skill on them
- Help the user evaluate the results both qualitatively and quantitatively
  - While the runs happen in the background, draft some quantitative evals if there aren't any (if there are some, you can either use as is or modify if you feel something needs to change about them). Then explain them to the user (or if they already existed, explain the ones that already exist)
  - Use the `eval-viewer/generate_review.py` script to show the user the results for them to look at, and also let them look at the quantitative metrics
- Rewrite the skill based on feedback from the user's evaluation of the results (and also if there are any glaring flaws that become apparent from the quantitative benchmarks)
- Repeat until you're satisfied
- Expand the test set and try again at larger scale

Your job when using this skill is to figure out where the user is in this process and then jump in and help them progress through these stages. So for instance, maybe they're like "I want to make a skill for X". You can help narrow down what they mean, write a draft, write the test cases, figure out how they want to ev…

On the other hand, maybe they already have a draft of the skill. In this case you can go straight to the eval/iterate part of the loop.

Of course, you should always be flexible and if the user is like "I don't need to run a bunch of evaluations, just vibe with me", you can do that instead.

Then after the skill is done (but again, the order is flexible), you can also run the skill description improver, which we have a whole separate script for, to optimize the triggering of the skill.

Cool? Cool.

## Communicating with the user
…

Ver todo o marketplace