nccl - Concept| Collective | Category |
|---|---|
| Broadcast | one-to-many |
| Reduce | many-to-one |
| Scatter | one-to-many |
| Gather | many-to-one |
| AllReduce | many-to-many |
| AllGather | many-to-many |
| ReduceScatter | many-to-many |
| AllToAll | many-to-many |