Skill · em Dados, IA e pesquisa

huggingface-accelerate

Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.

Procedência

Antes de instalar

4 arquivos · 42,9 KB · só texto, nenhum script

Instalar na sua CLI

O comando baixa a versão fixada (commit 57f899e) direto da origem, para a pasta que a CLI lê. Precisa de curl (macOS e Linux); no Windows não há comando, porque o Rook Labs é para macOS.

Claude Code

Neste projeto: instala em .claude/skills/huggingface-accelerate/.

d=".claude/skills/huggingface-accelerate"
u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-accelerate"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/references/custom-plugins.md" "$u/references/custom-plugins.md" \
  -o "$d/references/megatron-integration.md" "$u/references/megatron-integration.md" \
  -o "$d/references/performance.md" "$u/references/performance.md"

Global: instala em ~/.claude/skills/huggingface-accelerate/.

d="$HOME/.claude/skills/huggingface-accelerate"
u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-accelerate"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/references/custom-plugins.md" "$u/references/custom-plugins.md" \
  -o "$d/references/megatron-integration.md" "$u/references/megatron-integration.md" \
  -o "$d/references/performance.md" "$u/references/performance.md"

Codex

Neste projeto: instala em .agents/skills/huggingface-accelerate/.

d=".agents/skills/huggingface-accelerate"
u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-accelerate"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/references/custom-plugins.md" "$u/references/custom-plugins.md" \
  -o "$d/references/megatron-integration.md" "$u/references/megatron-integration.md" \
  -o "$d/references/performance.md" "$u/references/performance.md"

Global: instala em ~/.agents/skills/huggingface-accelerate/.

d="$HOME/.agents/skills/huggingface-accelerate"
u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-accelerate"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/references/custom-plugins.md" "$u/references/custom-plugins.md" \
  -o "$d/references/megatron-integration.md" "$u/references/megatron-integration.md" \
  -o "$d/references/performance.md" "$u/references/performance.md"

Antigravity

Neste projeto: instala em .agents/skills/huggingface-accelerate/.

d=".agents/skills/huggingface-accelerate"
u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-accelerate"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/references/custom-plugins.md" "$u/references/custom-plugins.md" \
  -o "$d/references/megatron-integration.md" "$u/references/megatron-integration.md" \
  -o "$d/references/performance.md" "$u/references/performance.md"

Global: instala em ~/.gemini/antigravity-cli/skills/huggingface-accelerate/.

d="$HOME/.gemini/antigravity-cli/skills/huggingface-accelerate"
u="https://raw.githubusercontent.com/davila7/claude-code-templates/57f899e5394bb8ca166f38eacae8f0853cbfe033/cli-tool/components/skills/ai-research/distributed-training-accelerate"
curl -fsSL --create-dirs \
  -o "$d/SKILL.md" "$u/SKILL.md" \
  -o "$d/references/custom-plugins.md" "$u/references/custom-plugins.md" \
  -o "$d/references/megatron-integration.md" "$u/references/megatron-integration.md" \
  -o "$d/references/performance.md" "$u/references/performance.md"

Peça ao Rook

Já usa o Rook Labs? Cole no chat do Rook: instale a skill https://rooklabs.sh/marketplace/cct.huggingface-accelerate

Prévia do SKILL.md

---
name: huggingface-accelerate
description: Simplest distributed training API. 4 lines to add distributed support to any PyTorch script. Unified API for DeepSpeed/FSDP/Megatron/DDP. Automatic device placement, mixed precision (FP16/BF16/FP8). Interactive config, single launch command. HuggingFace ecosystem standard.
version: 1.0.0
author: Orchestra Research
license: MIT
tags: [Distributed Training, HuggingFace, Accelerate, DeepSpeed, FSDP, Mixed Precision, PyTorch, DDP, Unified API, Simple]
dependencies: [accelerate, torch, transformers]
---

# HuggingFace Accelerate - Unified Distributed Training

## Quick start

Accelerate simplifies distributed training to 4 lines of code.

**Installation**:
```bash
pip install accelerate
```

**Convert PyTorch script** (4 lines):
```python
import torch
+ from accelerate import Accelerator

+ accelerator = Accelerator()

  model = torch.nn.Transformer()
  optimizer = torch.optim.Adam(model.parameters())
  dataloader = torch.utils.data.DataLoader(dataset)

+ model, optimizer, dataloader = accelerator.prepare(model, optimizer, dataloader)

  for batch in dataloader:
      optimizer.zero_grad()
      loss = model(batch)
-     loss.backward()
+     accelerator.backward(loss)
      optimizer.step()
…

Ver todo o marketplace