?
Proceedings of the 37th ACM International Conference on Supercomputing ,
2
A Hybrid Tensor-Expert-Data Parallelism Approach to Optimiz..:
, In:
?
SC22: International Conference for High Performance Computing, Networking, Storage and Analysis ,
3
DeepSpeed- Inference: Enabling Efficient Inference of Trans..:
, In:
?
SC21: International Conference for High Performance Computing, Networking, Storage and Analysis ,
4
ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Sca..:
, In:
?
Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis ,
5
ZeRO-infinity : breaking the GPU memory wall for extreme..:
, In:
?
Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis ,
6
ZeRO : memory optimizations toward training trillion par..:
, In:
?
Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining ,
7
DeepSpeed : System Optimizations Enable Training Deep Le..:
, In:
?
Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems ,
9
Optimizing CNNs on Multicores for Scalability, Performance ..:
, In:
?
Proceedings of the 18th ACM/IFIP/USENIX Middleware Conference ,
10
HyperDrive : exploring hyperparameters with POP scheduli..:
, In:
?
Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis ,
13
SERF : efficient scheduling for fast deep neural network..:
, In:
?
Proceedings of the 42nd Annual International Symposium on Computer Architecture ,
15