I agree that this site is using cookies. You can find further informations here.
X
Rajbhandari, Samyam
50  results:
Search for persons X
?
1

System Optimizations for Enabling Training of Extreme Long ..:

, In: Proceedings of the 43rd ACM Symposium on Principles of Distributed Computing,
Jacobs, Sam Ade ; Tanaka, Masahiro ; Zhang, Chengming... - p. 121-130 , 2024
Link: https://dl.acm.org/doi/1..
 
?
2

A Hybrid Tensor-Expert-Data Parallelism Approach to Optimiz..:

, In: Proceedings of the 37th ACM International Conference on Supercomputing,
Singh, Siddharth ; Ruwase, Olatunji ; Awan, Ammar Ahmad... - p. 203-214 , 2023
Link: https://dl.acm.org/doi/1..
 
?
3

DeepSpeed- Inference: Enabling Efficient Inference of Trans..:

, In: SC22: International Conference for High Performance Computing, Networking, Storage and Analysis,
Aminabadi, Reza Yazdani ; Rajbhandari, Samyam ; Awan, Ammar Ahmad... - p. 1-15 , 2022
Link: https://doi.org/10.1109/..
 
?
4

1-bit LAMB: Communication Efficient Large-Scale Large-Batch..:

, In: 2022 IEEE 29th International Conference on High Performance Computing, Data, and Analytics (HiPC),
Li, Conglong ; Awan, Ammar Ahmad ; Tang, Hanlin.. - p. 272-281 , 2022
Link: https://doi.org/10.1109/..
 
?
5

ZeRO-infinity : breaking the GPU memory wall for extreme..:

, In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis,
Rajbhandari, Samyam ; Ruwase, Olatunji ; Rasley, Jeff.. - p. 1-14 , 2021
Link: https://dl.acm.org/doi/1..
 
?
6

ZeRO-Infinity: Breaking the GPU Memory Wall for Extreme Sca..:

, In: SC21: International Conference for High Performance Computing, Networking, Storage and Analysis,
Rajbhandari, Samyam ; Ruwase, Olatunji ; Rasley, Jeff.. - p. 1-15 , 2021
Link: https://doi.org/10.1145/..
 
?
7

DeepSpeed : System Optimizations Enable Training Deep Le..:

, In: Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining,
Rasley, Jeff ; Rajbhandari, Samyam ; Ruwase, Olatunji. - p. 3505-3506 , 2020
Link: https://dl.acm.org/doi/1..
 
?
8

ZeRO : memory optimizations toward training trillion par..:

, In: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis,
Rajbhandari, Samyam ; Rasley, Jeff ; Ruwase, Olatunji. - p. 1-16 , 2020
Link: https://dl.acm.org/doi/1..
 
?
9

Fast LSTM by dynamic decomposition on cloud and distributed..:

You, Yang ; He, Yuxiong ; Rajbhandari, Samyam...
Knowledge and Information Systems.  62 (2020)  11 - p. 4169-4197 , 2020
Link: https://doi.org/10.1007/..
 
?
10

Fast LSTM Inference by Dynamic Decomposition on Cloud Syste..:

, In: 2019 IEEE International Conference on Data Mining (ICDM),
You, Yang ; He, Yuxiong ; Rajbhandari, Samyam... - p. 748-757 , 2019
Link: https://doi.org/10.1109/..
 
?
11

Optimizing CNNs on Multicores for Scalability, Performance ..:

Rajbhandari, Samyam ; He, Yuxiong ; Ruwase, Olatunji..
ACM SIGPLAN Notices.  52 (2017)  4 - p. 267-280 , 2017
Link: https://doi.org/10.1145/..
 
?
12

Optimizing CNNs on Multicores for Scalability, Performance ..:

Rajbhandari, Samyam ; He, Yuxiong ; Ruwase, Olatunji..
ACM SIGOPS Operating Systems Review.  51 (2017)  2 - p. 267-280 , 2017
Link: https://doi.org/10.1145/..
 
?
13

Optimizing the Four-Index Integral Transform Using Data Mov..:

Rajbhandari, Samyam ; Rastello, Fabrice ; Kowalski, Karol..
ACM SIGPLAN Notices.  52 (2017)  8 - p. 327-340 , 2017
Link: https://doi.org/10.1145/..
 
?
14

Optimizing CNNs on Multicores for Scalability, Performance ..:

, In: Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating Systems,
Rajbhandari, Samyam ; He, Yuxiong ; Ruwase, Olatunji.. - p. 267-280 , 2017
Link: https://dl.acm.org/doi/1..
 
?
15

Optimizing the Four-Index Integral Transform Using Data Mov..:

, In: Proceedings of the 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming,
Rajbhandari, Samyam ; Rastello, Fabrice ; Kowalski, Karol.. - p. 327-340 , 2017
Link: https://dl.acm.org/doi/1..
 
1-15