AxoNN

AxoNN is a parallel framework for training deep neural networks.

User Docs

• Getting Started
  • Prerequisites
  • Installation
• AxoNN User Guide
  • Initializing AxoNN
  • Mapping your dataloaders to GPUs.
  • Parallelizing Your Model with AxoNN’s Tensor Parallelism
  • Putting it all together
  • Integration with other Parallel APIs
• Advanced Usage
  • The Advanced Tensor Parallel API
  • Combining AxoNN’s Tensor Parallelism with Data Parallelism
  • Parallelizing Your Model with AxoNN’s Pipeline Parallelism
  • Combining AxoNN’s Pipeline Parallelism with Data Parallelism
  • Combining AxoNN’s Tensor, Pipeline and Data Parallelism
• Examples
  • Training
  • Fine-tuning
  • Inference

Indices and tables

• Index

• Module Index

• Search Page