Skip to content

Commit 40f8cb7

Browse files
authored
[doc] update requirements and documents (#23)
1 parent 3d8546f commit 40f8cb7

File tree

3 files changed

+8
-6
lines changed

3 files changed

+8
-6
lines changed

Install.md

+1-3
Original file line numberDiff line numberDiff line change
@@ -70,9 +70,7 @@ conda activate moe_peft
7070
# Install requirements
7171
pip3 install -r requirements.txt --upgrade
7272
# Install extra requirements
73-
pip3 install ninja
74-
pip3 install bitsandbytes==0.43.1
75-
pip3 install flash-attn==2.5.8 --no-build-isolation
73+
bash misc/install-extra-linux.sh
7674
```
7775

7876
## Verification

README.md

+3-3
Original file line numberDiff line numberDiff line change
@@ -34,15 +34,15 @@ You can use the `MOE_PEFT_EXECUTOR_TYPE` environment variable to force MoE-PEFT
3434
| | Model | Model Size |
3535
|---------|--------------------------------------------------|-------------|
3636
| ✓ | [LLaMA 1/2](https://huggingface.co/meta-llama) | 7B/13B/70B |
37-
| ✓ | [LLaMA 3/3.1](https://huggingface.co/meta-llama) | 8B/70B |
37+
| ✓ | [LLaMA 3.x](https://huggingface.co/meta-llama) | 3B/8B/70B |
3838
| ✓ | [Yi 1/1.5](https://huggingface.co/01-ai) | 6B/9B/34B |
3939
| ✓ | [TinyLLaMA](https://huggingface.co/TinyLlama) | 1.1B |
40-
| ✓ | [Qwen 1.5/2](https://huggingface.co/Qwen) | 0.5B ~ 72B |
40+
| ✓ | [Qwen 1.5/2.x](https://huggingface.co/Qwen) | 0.5B ~ 72B |
4141
| ✓ | [Gemma](https://huggingface.co/google) | 2B/7B |
4242
| ✓ | [Gemma 2](https://huggingface.co/google) | 9B/27B |
4343
| ✓ | [Mistral](https://huggingface.co/mistralai) | 7B |
4444
| ✓ | [Phi 1.5/2](https://huggingface.co/microsoft) | 2.7B |
45-
| ✓ | [Phi 3/3.5](https://huggingface.co/microsoft) | 3.8B/7B/14B |
45+
| ✓ | [Phi 3.x/4](https://huggingface.co/microsoft) | 3.8B/7B/14B |
4646
| ✓ | [ChatGLM 1/2/3](https://huggingface.co/THUDM) | 6B |
4747
| ✓ | [GLM 4](https://huggingface.co/THUDM) | 6B |
4848

misc/install-extra-linux.sh

+4
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
# Install extra requirements
2+
pip3 install ninja
3+
pip3 install bitsandbytes==0.44.1
4+
pip3 install flash-attn==2.6.3 --no-build-isolation

0 commit comments

Comments
 (0)