Faster beam search part2/2

[justheuristic]

we're currently trying alternative solution in #103, this PR will not receive updates for several days

• add beam search function to hivemind.dht.DHT (rationale: reduce inter-process communication)
• add batch-parallel beam search
• add option for limited time_budget in beam search
• DHT, DHTNode: shutdown on __del__ (LATER)
• CircleCI: rollback changes from part1 (was: temporary failure on their side)
• remove beam search from moe.py
• add tests for all new functionality
  • get/store locally
  • find_best_experts
  • batch_find_best_experts
• add beam search benchmark to benchmark_dht

On time budget: if time_budget != float('inf'), beam search will send requests to peers only within this budget and return best experts it could find in cache

[justheuristic]

Sorry for the delay, im back after ICLR

[Maria1007]

What is it？and What should I do？ Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: justheuristic <[email protected]> Sent: Wednesday, September 30, 2020 9:18:00 AM To: learning-at-home/hivemind <[email protected]> Cc: Subscribed <[email protected]> Subject: Re: [learning-at-home/hivemind] Faster beam search part2/2 (#101) Sorry for the delay, im back after ICLR ― You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub<#101 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AQ4XPTCCZVUPTN26KH76VM3SIKBMRANCNFSM4ROV6NYA>.

[justheuristic]

@Maria1007 This email hit you because you are subscribed to repository updates. You don't need to do anything in particular about this.

If you dont' want to receive notification e-mails, you can press un-watch in the top-right bar