Tags: learning-at-home/hivemind
Tags
Fix TypeError in P2P._terminate() (#579) Fix bigscience-workshop/petals#237, bigscience-workshop/petals#368 (comment).
Fix errors in hivemind.p2p and hivemind.compression (#565) This PR: 1. Fixes warnings in hivemind.p2p destructors. 2. Makes bfloat16 serialization in hivemind.compression forward- and backward-compatible. The code before this PR (a) didn't work in torch < 1.13.0 (hivemind requires torch >= 1.9.0) and (b) led to warnings on torch >= 2.0. The new code works without warnings in all versions of PyTorch.
PreviousNext