Distributed Neighbor Expansion (Distributed NE) : A scalable parallel and distributed graph partitioner for high-quality edge partitioning, which has several key features:
- Low-memory and high-performance implementation
- Provide high-quality edge partitionins
- Scalable to trillion-edge graphs on 200+ machines (1 trillion = 1,000,000,000,000)
Reference
M. Hanai, et.al. "Distributed Edge Partitioning for Trillion-edge Graphs" (PVLDB 2019, Paper)
$ git clone [email protected]:masatoshihanai/DistributedNE.git
$ cd DistributedNE; mkdir build; cd build
$ cmake ..; make ## Require MPI
$ mpirun -n 4 ./DistributedNE ../data/Slashdot.edges 4