Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DeepSpeedExamples major restructure #245

Merged
merged 5 commits into from
Mar 31, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
18 changes: 0 additions & 18 deletions .pre-commit-config.yaml

This file was deleted.

18 changes: 10 additions & 8 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,15 +1,17 @@

# DeepSpeed Examples
This repository contains various example models that use [DeepSpeed](https://github.com/microsoft/DeepSpeed) for training and inference.
This repository contains various examples including training, inference, compression, benchmarks, and applications that use [DeepSpeed](https://github.com/microsoft/DeepSpeed).

## 1. Training
There are several training and finetuning examples so please see the individual folders for specific instructions.

# Inference Examples
## 2. Inference
The DeepSpeed Huggingface inference [README](./inference/huggingface/README.md) explains how to get started with running DeepSpeed Huggingface inference examples.

# Training Examples
There are several trianing examples in this repository. Please see the individual folders.
## 3. Compression
Model compression examples.

## Note on Megatron examples
Please use the latest [Megatron-DeepSpeed fork](https://github.com/microsoft/Megatron-DeepSpeed) instead of the deprecated/old megatron forks in the megatron folder.
## 4. Benchmarks
TODO: Move the DeepSpeed benchmarks folder here.

# Contributing

Expand All @@ -23,4 +25,4 @@ provided by the bot. You will only need to do this once across all repos using o

This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).
For more information see the [Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/) or
contact [opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional questions or comments.
contact [opencode@microsoft.com](mailto:opencode@microsoft.com) with any additional questions or comments.
1 change: 1 addition & 0 deletions benchmarks/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
The new home for DeepSpeed benchmarks. TODO: Move DS benchmarks to this repo.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
File renamed without changes.
264 changes: 0 additions & 264 deletions megatron/Megatron-LM-v1.1.5-3D_parallelism/LICENSE

This file was deleted.

2 changes: 0 additions & 2 deletions megatron/Megatron-LM-v1.1.5-3D_parallelism/MANIFEST.in

This file was deleted.

Loading