The PyTorch Developer Podcast is a place for the PyTorch dev team to do bite sized (10-20 min) topics about all sorts of internal development topics in PyTorch.... more
Share PyTorch Developer Podcast
Share to email
Share to Facebook
Share to X
By Edward Yang, Team PyTorch
4.8
4141 ratings
The podcast currently has 83 episodes available.
Compiler collectives are a PT2 feature where by compiler instances across multiple ranks use NCCL collectives to communicate information to other instances. This is used to ensure we consistently decide if inputs or static or dynamic across all ranks. See also PR at https://github.com/pytorch/pytorch/pull/130935
The podcast currently has 83 episodes available.
14,683 Listeners
958 Listeners
580 Listeners
3,073 Listeners
2,851 Listeners
178 Listeners
12,625 Listeners
188 Listeners
86 Listeners
248 Listeners
5,184 Listeners
60 Listeners
109 Listeners
49 Listeners
505 Listeners