Skill · em Dados, IA e pesquisa
deepspeed
Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention
Procedência
- Origem: davila7/claude-code-templates
- Caminho:
cli-tool/components/skills/ai-research/distributed-training-deepspeed - Versão fixada:
57f899e5394bb8ca166f38eacae8f0853cbfe033 - Licença: MIT
- Espelhado em 25/09/2026
- 1 download no Claude Code Templates (lido em 25/09/2026)
Antes de instalar
10 arquivos · 769,9 KB · só texto, nenhum script
Instalar na sua CLI
O comando baixa a versão fixada (commit 57f899e) direto da origem, para a pasta que a CLI lê. Precisa de curl (macOS e Linux); no Windows não há comando, porque o Rook Labs é para macOS.
Claude Code
Neste projeto: instala em .claude/skills/deepspeed/.
d=".claude/skills/deepspeed" u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-deepspeed" curl -fsSL --create-dirs \ -o "$d/SKILL.md" "$u/SKILL.md" \ -o "$d/references/08.md" "$u/references/08.md" \ -o "$d/references/09.md" "$u/references/09.md" \ -o "$d/references/2020.md" "$u/references/2020.md" \ -o "$d/references/2023.md" "$u/references/2023.md" \ -o "$d/references/assets.md" "$u/references/assets.md" \ -o "$d/references/index.md" "$u/references/index.md" \ -o "$d/references/mii.md" "$u/references/mii.md" \ -o "$d/references/other.md" "$u/references/other.md" \ -o "$d/references/tutorials.md" "$u/references/tutorials.md"
Global: instala em ~/.claude/skills/deepspeed/.
d="$HOME/.claude/skills/deepspeed" u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-deepspeed" curl -fsSL --create-dirs \ -o "$d/SKILL.md" "$u/SKILL.md" \ -o "$d/references/08.md" "$u/references/08.md" \ -o "$d/references/09.md" "$u/references/09.md" \ -o "$d/references/2020.md" "$u/references/2020.md" \ -o "$d/references/2023.md" "$u/references/2023.md" \ -o "$d/references/assets.md" "$u/references/assets.md" \ -o "$d/references/index.md" "$u/references/index.md" \ -o "$d/references/mii.md" "$u/references/mii.md" \ -o "$d/references/other.md" "$u/references/other.md" \ -o "$d/references/tutorials.md" "$u/references/tutorials.md"
Codex
Neste projeto: instala em .agents/skills/deepspeed/.
d=".agents/skills/deepspeed" u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-deepspeed" curl -fsSL --create-dirs \ -o "$d/SKILL.md" "$u/SKILL.md" \ -o "$d/references/08.md" "$u/references/08.md" \ -o "$d/references/09.md" "$u/references/09.md" \ -o "$d/references/2020.md" "$u/references/2020.md" \ -o "$d/references/2023.md" "$u/references/2023.md" \ -o "$d/references/assets.md" "$u/references/assets.md" \ -o "$d/references/index.md" "$u/references/index.md" \ -o "$d/references/mii.md" "$u/references/mii.md" \ -o "$d/references/other.md" "$u/references/other.md" \ -o "$d/references/tutorials.md" "$u/references/tutorials.md"
Global: instala em ~/.agents/skills/deepspeed/.
d="$HOME/.agents/skills/deepspeed" u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-deepspeed" curl -fsSL --create-dirs \ -o "$d/SKILL.md" "$u/SKILL.md" \ -o "$d/references/08.md" "$u/references/08.md" \ -o "$d/references/09.md" "$u/references/09.md" \ -o "$d/references/2020.md" "$u/references/2020.md" \ -o "$d/references/2023.md" "$u/references/2023.md" \ -o "$d/references/assets.md" "$u/references/assets.md" \ -o "$d/references/index.md" "$u/references/index.md" \ -o "$d/references/mii.md" "$u/references/mii.md" \ -o "$d/references/other.md" "$u/references/other.md" \ -o "$d/references/tutorials.md" "$u/references/tutorials.md"
Antigravity
Neste projeto: instala em .agents/skills/deepspeed/.
d=".agents/skills/deepspeed" u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-deepspeed" curl -fsSL --create-dirs \ -o "$d/SKILL.md" "$u/SKILL.md" \ -o "$d/references/08.md" "$u/references/08.md" \ -o "$d/references/09.md" "$u/references/09.md" \ -o "$d/references/2020.md" "$u/references/2020.md" \ -o "$d/references/2023.md" "$u/references/2023.md" \ -o "$d/references/assets.md" "$u/references/assets.md" \ -o "$d/references/index.md" "$u/references/index.md" \ -o "$d/references/mii.md" "$u/references/mii.md" \ -o "$d/references/other.md" "$u/references/other.md" \ -o "$d/references/tutorials.md" "$u/references/tutorials.md"
Global: instala em ~/.gemini/antigravity-cli/skills/deepspeed/.
d="$HOME/.gemini/antigravity-cli/skills/deepspeed" u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-deepspeed" curl -fsSL --create-dirs \ -o "$d/SKILL.md" "$u/SKILL.md" \ -o "$d/references/08.md" "$u/references/08.md" \ -o "$d/references/09.md" "$u/references/09.md" \ -o "$d/references/2020.md" "$u/references/2020.md" \ -o "$d/references/2023.md" "$u/references/2023.md" \ -o "$d/references/assets.md" "$u/references/assets.md" \ -o "$d/references/index.md" "$u/references/index.md" \ -o "$d/references/mii.md" "$u/references/mii.md" \ -o "$d/references/other.md" "$u/references/other.md" \ -o "$d/references/tutorials.md" "$u/references/tutorials.md"
Peça ao Rook
Já usa o Rook Labs? Cole no chat do Rook: instale a skill https://rooklabs.sh/marketplace/cct.deepspeed
Prévia do SKILL.md
---
name: deepspeed
description: Expert guidance for distributed training with DeepSpeed - ZeRO optimization stages, pipeline parallelism, FP16/BF16/FP8, 1-bit Adam, sparse attention
version: 1.0.0
author: Orchestra Research
license: MIT
tags: [DeepSpeed, Distributed Training, ZeRO, Pipeline Parallelism, Mixed Precision, Optimization, Microsoft, Large-Scale Training, FP16, FP8]
dependencies: [deepspeed, torch, transformers, accelerate]
---
# Deepspeed Skill
Comprehensive assistance with deepspeed development, generated from official documentation.
## When to Use This Skill
This skill should be triggered when:
- Working with deepspeed
- Asking about deepspeed features or APIs
- Implementing deepspeed solutions
- Debugging deepspeed code
- Learning deepspeed best practices
## Quick Reference
### Common Patterns
**Pattern 1:** DeepNVMe Contents Requirements Creating DeepNVMe Handles Using DeepNVMe Handles Blocking File Write Non-Blocking File Write Parallel File Write Pinned Tensors Putting it together Acknowledgements Appendix Advanced Handle Creation Performance Tuning DeepNVMe APIs General I/O APIs GDS-specific APIs Handle …
```
libaio
```
**Pattern 2:** Mixture of Experts for NLG models Contents 1. Installation 2. Training NLG+MoE models 2.1. Changes to the model 2.2. Pre-training the Standard MoE model 2.3. Pre-training the PR-MoE model 2.4. Training MoS with reduced model size In this tutorial, we introduce how to apply DeepSpeed Mixture of Experts (M…
```
megatron/model/
```
**Pattern 3:** MoS, standing for Mixture-of-Students, is a staged distillation-based technique for compressing large MoE models. MoS further reduces the model size by 12.5%, leading to up 3.7x model size reduction when combined with PR-MoE over the standard MoE. The reduced model size helps reduce the latency and cost …
…