skill detail

distributed-llm-pretraining-torchtitan

Orchestra-Research/distributed-llm-pretraining-torchtitan

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP).

communityprovisionalaiaiai-research

skillrank score

█████████░░░░░░░55

SkillRank score blends community stars, real usage, and our eval lift; provisional until a skill is evaluated -- so popularity alone can't reach the top tier.

source

★ 10.5k

Orchestra-Research/AI-Research-SKILLs

01-model-architecture/torchtitan

open on GitHub ▸

eval status

eval pending

Success delta, token delta, and trial count are not available yet. No eval number is shown until this skill has measured results.

install

$ skillrank install Orchestra-Research/distributed-llm-pretraining-torchtitan

$ curl -fsSL skillrank.dev | sh