DeepSpeed Examples
This repository contains various examples including training, inference, compression, benchmarks, and applications that use DeepSpeed.1. Applications
This folder contains end-to-end applications that use DeepSpeed to train and use cutting-edge models.2. Training
There are several training and finetuning examples so please see the individual folders for specific instructions.3. Inference
- The DeepSpeed-MII inference README explains how to get started with running model inference with DeepSpeed-MII and DeepSpeed-FastGen.
- The DeepSpeed Huggingface inference README explains how to get started with running DeepSpeed Huggingface inference examples.