0.9.0: Decentralized parameter averaging

• Implement DecentralizedAverager for averaging model parameters & statistics across DHT peers (#119 #123 #134 #140 #141)
• Accelerate RemoteMixtureOfExperts beam search with new key structure (#97 #101 #103 #109)
• Implement lossy compression algorithms for tensors (#102 #106 #112)
• Detect anomalies in RemoteMixtureOfExperts (#132)
• Configure gRPC channels for long-term stability (#129 #131)
• Load expert checkpoints on server startup (#138)
• Support attention mask in example TransformerEncoder layer (#126)
• Add the contribution guide (#156)

Bugfixes:

• Fix wrong getattr in hivemind.Server (#122)

Enhancements:

• Suport python3.9 and torch1.7 (#142)
• Blacklist nonresponsive peers with exponential backoff (#114)
• Reuse grpc channels between calls (#120)
• Verify DHT peer accessibility and local clock (#137)
• Improve logging, remove duplicate log entries (#135)
• Improve test coverage (#116)

hivemind 0.8.2

• Remove name property from all asyncio tasks (compatibility with python3.7)

hivemind 0.8.1

Minor update:

• you can now create minimalistic hivemind server via ./script/run_server.py @Vsevolod-pl
• ./script/run_server.py can now sample experts from a pre-defined grid, e.g. expert.[0:256].[0:256]
• added quickstart tutorial @justheuristic

hivemind 0.8.0

• Speed up tests, shutdown threads in server via threading.Event
• Compile protobuf in setup.py
• Update circleci pipelines
• Update RTD pipeline
• Refactor custom build_ext into install and develop

hivemind 0.7.1

v0.7.1

add url to setup.py