Commefficient

PyTorch for benchmarking communication-efficient distributed SGD optimization algorithms