Add MLP/lm_head tp grain size setting.#6828

Merged

loadams merged 8 commits intodeepspeedai:masterfrom Yejing-Lai:lyj/tp_grain_size

Dec 16, 2024

+15-4

Commits on Dec 5, 2024

add tp grain size
Yejing-Lai
committed

Commits on Dec 6, 2024

Merge branch 'master' into lyj/tp_grain_size
loadams
authored

Commits on Dec 10, 2024

Commits on Dec 11, 2024

updated tp_grain_size to tensor_parallel field
Yejing-Lai
committed

Commits on Dec 12, 2024

Merge branch 'master' into lyj/tp_grain_size
tjruwase
authored

Commits on Dec 14, 2024

Merge branch 'master' into lyj/tp_grain_size
tjruwase
authored

Commits on Dec 16, 2024

Merge branch 'master' into lyj/tp_grain_size
loadams
authored