Install in seconds
Install this skill
Copy the command and run it in your terminal. You can review the source before installing.
terminal
git clone https://github.com/Orchestra-Research/AI-Research-SKILLs

Works with Git. The repository opens in your current directory.

🧠
AI EngineeringTeX

LLaMA Factory

by Orchestra-Research

Expert guidance for fine-tuning LLMs with LLaMA-Factory: a no-code WebUI, support for 100+ models, QLoRA in 2-8 bits, and multimodal capabilities.

11.2K stars821 forksAdded 2026/07/19
aiai-researchclaudeclaude-codeclaude-skillscodexgeminigpt-5grpohuggingfacemachine-leanringmegatronskillsvllm

Documentation

README

Llama-Factory Skill

Comprehensive assistance with llama-factory development, generated from official documentation.

When to Use This Skill

This skill should be triggered when:

  • Working with llama-factory
  • Asking about llama-factory features or APIs
  • Implementing llama-factory solutions
  • Debugging llama-factory code
  • Learning llama-factory best practices

Quick Reference

Common Patterns

Quick reference patterns will be added as you use the skill.

Reference Files

This skill includes comprehensive documentation in references/:

  • _images.md - Images documentation
  • advanced.md - Advanced documentation
  • getting_started.md - Getting Started documentation
  • other.md - Other documentation

Use view to read specific reference files when detailed information is needed.

Working with This Skill

For Beginners

Start with the getting_started or tutorials reference files for foundational concepts.

For Specific Features

Use the appropriate category reference file (api, guides, etc.) for detailed information.

For Code Examples

The quick reference section above contains common patterns extracted from the official docs.

Resources

references/

Organized documentation extracted from official sources. These files contain:

  • Detailed explanations
  • Code examples with language annotations
  • Links to original documentation
  • Table of contents for quick navigation

scripts/

Add helper scripts here for common automation tasks.

assets/

Add templates, boilerplate, or example projects here.

Notes

  • This skill was automatically generated from official documentation
  • Reference files preserve the structure and examples from source docs
  • Code examples include language detection for better syntax highlighting
  • Quick reference patterns are extracted from common usage examples in the docs

Updating

To refresh this skill with updated documentation:

  1. Re-run the scraper with the same configuration
  2. The skill will be rebuilt with the latest information

More from Orchestra-Research

Other Claude Code skills by this author in the directory.

1w ago

LitGPT LLM Implementation

Implements and trains LLMs using LitGPT with 20+ architectures like Llama, Gemma, Phi. Use for clean model implementations, understanding architectures, or production fine-tuning with LoRA/QLoRA. Single-file, no abstraction layers.
AI Engineering
+1%11.2K821
🐍
1w ago

Mamba Architecture

Implements Mamba state-space models achieving O(n) complexity for sequence modeling. Enables 5× faster inference, million-token sequences, and no KV cache. Ideal for streaming and long-context applications.
AI Engineering
+1%11.2K821
🧠
1w ago

nanoGPT

A minimalist, educational GPT implementation in ~300 lines of code. Ideal for learning transformer architectures from scratch; supports training on Shakespeare (CPU) or reproducing GPT-2 on OpenWebText (multi-GPU).
AI Engineering
+1%11.2K821
🧠
1w ago

RWKV Architecture

A skill for using RWKV, the RNN-Transformer hybrid model that offers linear-time inference, infinite context, and constant memory. Covers installation, text generation, long context processing, fine-tuning, and comparison with Transformers.
AI Engineering
+1%11.2K821
🔥
1w ago

TorchTitan LLM Pretraining

Provides PyTorch-native distributed LLM pretraining using torchtitan with 4D parallelism (FSDP2, TP, PP, CP). Use when pretraining Llama 3.1, DeepSeek V3, or custom models at scale from 8 to 512+ GPUs with Float8, torch.compile, and distributed checkpointing.
AI Engineering
+1%11.2K821
1w ago

HuggingFace Tokenizers

Rust-based tokenization library for NLP that processes 1GB of text in under 20 seconds. Supports BPE, WordPiece, and Unigram algorithms, custom vocabulary training, and seamless transformers integration for research and production.
AI Engineering
+1%11.2K821