Search results

[REQUEST]Do deepspeed support megatron's <code>--sequence_parallel</code>？

enhancementNew feature or requestNew feature or request

Status: Open.

#7339 In deepspeedai/DeepSpeed;

· janelu9 opened on Jun 6, 2025

Test hangs when world_size=4 and reuse_dist_env=True on PyTorch &gt;= 2.7.0

ci-failure

Status: Open.

#7334 In deepspeedai/DeepSpeed;

· inkcherry opened on Jun 4, 2025

[REQUEST]I want to use CPU-based distributed approach to train a small recommendation model. Is there a demo available for me to refer ?

enhancementNew feature or requestNew feature or request

Status: Open.

#7329 In deepspeedai/DeepSpeed;

· Lenan22 opened on Jun 3, 2025

Functorch support: RuntimeError: In order to use an autograd.Function with functorch transforms

Status: Open.

#7323 In deepspeedai/DeepSpeed;

· ifiaposto opened on Jun 1, 2025

[BUG]Training

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7319 In deepspeedai/DeepSpeed;

· sravan500 opened on May 29, 2025

Does DeepSpeed support the training of large-scale recommender systems (RecSys)？

Status: Open.

#7318 In deepspeedai/DeepSpeed;

· Lenan22 opened on May 29, 2025

[BUG]RuntimeError: Distributed package doesn't have NCCL built in. Training on huawei NPU

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7312 In deepspeedai/DeepSpeed;

· whisper0055 opened on May 26, 2025

[BUG] DeepCompile: MemoryProfiling error /pytorch/build/aten/src/ATen/RegisterCUDA.cpp:7280: SymIntArrayRef expected to contain only concrete integers

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7311 In deepspeedai/DeepSpeed;

· unavailableun opened on May 26, 2025

nv-sd CI test failure

ci-failure

Status: Open.

#7310 In deepspeedai/DeepSpeed;

· github-actions opened on May 25, 2025

Bug when using optimizer and WarmupLR togather

Status: Open.

#7303 In deepspeedai/DeepSpeed;

· wjw136 opened on May 22, 2025

[BUG] AutoTP: incorrect total train batch size when using the huggingface trainer API

bugSomething isn't workingSomething isn't working

training

Status: Open.

#7298 In deepspeedai/DeepSpeed;

· cynricfu opened on May 20, 2025

[BUG] Installation doesn't work (Unable to import torch, pre-compiling ops will be disabled.)

installInstallation and package dependenciesInstallation and package dependencies

windowsQuestions or PRs relating to running DeepSpeed on WindowsQuestions or PRs relating to running DeepSpeed on Windows

Status: Open.

#7286 In deepspeedai/DeepSpeed;

· EugeoSynthesisThirtyTwo opened on May 15, 2025