MSCCL++ v0.2.0 Release Plan (Released)

[chhwang]

Timeline

Released Date: Jul 11th, 2023

Work Items

Communication Features and Interfaces

GPU-side communication interfaces (DeviceChannel)

1. • Proxy-based Interfaces: ProxyChannel (Olli/api extension #66)
2. • In-SM Copy Interfaces: SmChannel (Implement MMIO with put and signal  #55)
3. • Packet Copy Interfaces: putPackets(), getPackets(), signalPacket() (Add packet copy (LL) for AllReduce #85, [Performance] AllReduce performance debugging #90, DirectChannel Unit Tests #102)

Host-side interfaces

1. • Bootstrap: fix socket performance issue & bugs ([Bug] Hanging bootstrap communication #92, Fix hanging bootstrap issues #100, bootstrap now takes interface #113)
2. • Communicator: implement (Olli/api extension #66)
3. • ChannelService: host epoch support TBD (@saeedmaleki, Merge api-extension branch to main #75) Moved to v0.3.0 release plan

Transports support

1. • NVLink: implement (Olli/api extension #66)
2. • InfiniBand: implement (Olli/api extension #66)
3. • InfiniBand: tackle memory consistency issues (Saemal/atomic signal #96)

Performance Optimization

1. • Throughput: pass AllGather perf qualification (Rewrite mscclpp-test with cpp style API #77)
2. • Throughput: pass AllReduce perf qualification ([mscclpp-test] Add AllReduce and AllToAll tests #83, [Performance] AllReduce performance debugging #90)
3. • Throughput: pass AllToAll perf qualification ([mscclpp-test] Add AllToAll tests #87)
4. • Latency: pass AllGather perf qualification (@chhwang, @Binyang2014) Moved to v0.3.0 release plan
5. • Latency: pass AllReduce perf qualification (Add packet copy (LL) for AllReduce #85, [Performance] AllReduce performance debugging #90)
6. • Latency: pass AllToAll perf qualification (@Binyang2014) Moved to v0.3.0 release plan
7. • Latency: fix broken GDRCopy support (@chhwang) Moved to v0.3.0 release plan
8. • Latency: pass 2-node AllReduce perf qualification (Packet copy for IB #109, 2-node AllReduce improvements #118)

Development Pipeline

1. • Unit Tests: cover all interfaces (Update unit tests #81, A test for the core assumption of data + signal of MSCCL++ #91)
2. • mscclpp-test: add AllGather (Rewrite mscclpp-test with cpp style API #77)
3. • mscclpp-test: add AllReduce ([mscclpp-test] Add AllReduce and AllToAll tests #83)
4. • mscclpp-test: add AllToAll ([mscclpp-test] Add AllToAll tests #87)
5. • Debugging Tool: fix broken NPKit support (@yzygitzh) Moved to v0.3.0 release plan
6. • CI: lint, spelling, CodeQL (Update CI #79)
7. • CI: unit test (Update unit tests #81)
8. • CI: mscclpp-test (Setup Azure pipeline to run mscclpp-test #93, update pipeline #103)
9. • Package: publish Docker images (Add Dockerfiles #104)

Documents

1. • Doxygen: add configuration (Add Doxygen-based document #72)
2. • README: enhance details (Update docs #88)
3. • License: add license comments on all files (Add license comments #106)
4. • Code: cleanup & comments (Cleanup old files and functions #86, Documents & minor updates #119)

[chhwang]

Released: https://github.com/microsoft/mscclpp/releases/tag/v0.2.0