Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[core][experimental] Support broadcast NCCL ops in accelerated DAG #45308

Open
Tracked by #43830
stephanie-wang opened this issue May 13, 2024 · 0 comments
Open
Tracked by #43830

[core][experimental] Support broadcast NCCL ops in accelerated DAG #45308

stephanie-wang opened this issue May 13, 2024 · 0 comments
Labels
accelerated-dag enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks performance usability
Milestone
ADAG Developer Pr...

Comments

@stephanie-wang
Copy link
Contributor

Description

When the same GPU tensor is sent to multiple readers, we should use ncclBroadcast under the hood to reduce transfer time.

Use case

No response
@stephanie-wang stephanie-wang added enhancement Request for new feature and/or capability triage Needs triage (eg: priority, bug/not-bug, and owning component) accelerated-dag P1 Issue that should be fixed within a few weeks and removed triage Needs triage (eg: priority, bug/not-bug, and owning component) labels May 13, 2024
@stephanie-wang stephanie-wang mentioned this issue May 13, 2024
Open
5 tasks
@stephanie-wang stephanie-wang self-assigned this May 13, 2024
@anyscalesam anyscalesam added this to the ADAG Developer Preview milestone May 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
accelerated-dag enhancement Request for new feature and/or capability P1 Issue that should be fixed within a few weeks performance usability
Projects
None yet
Milestone
ADAG Developer Preview
Development

No branches or pull requests
2 participants
@stephanie-wang @anyscalesam