I agree that this site is using cookies. You can find further informations here.
X
Aminabadi, Reza Yazdani
24  results:
Online X
Search for persons X
?
1

System Optimizations for Enabling Training of Extreme Long ..:

, In: 2024 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW),
Jacobs, Sam Ade ; Tanaka, Masahiro ; Zhang, Chengming... - p. 1206-1208 , 2024
Link: https://doi.org/10.1109/..
 
?
2

SHARP: An Adaptable, Energy-Efficient Accelerator for Recur..:

Aminabadi, Reza Yazdani ; Ruwase, Olatunji ; Zhang, Minjia...
ACM Transactions on Embedded Computing Systems.  22 (2023)  2 - p. 1-23 , 2023
Link: https://doi.org/10.1145/..
 
?
3

DeepSpeed- Inference: Enabling Efficient Inference of Trans..:

, In: SC22: International Conference for High Performance Computing, Networking, Storage and Analysis,
Aminabadi, Reza Yazdani ; Rajbhandari, Samyam ; Awan, Ammar Ahmad... - p. 1-15 , 2022
Link: https://doi.org/10.1109/..
 
?
4

DeepSpeed-FastGen: High-throughput Text Generation for LLMs..:

Holmes, Connor ; Tanaka, Masahiro ; Wyatt, Michael...
http://arxiv.org/abs/2401.08671.  , 2024
Link: http://arxiv.org/abs/240..
 
?
5

Understanding INT4 Quantization for Transformer Models: Lat..:

Wu, Xiaoxia ; Li, Cheng ; Aminabadi, Reza Yazdani..
http://arxiv.org/abs/2301.12017.  , 2023
Link: http://arxiv.org/abs/230..
 
?
6

ZeroQuant-HERO: Hardware-Enhanced Robust Optimized Post-Tra..:

Yao, Zhewei ; Aminabadi, Reza Yazdani ; Youn, Stephen...
http://arxiv.org/abs/2310.17723.  , 2023
Link: http://arxiv.org/abs/231..
 
?
7

ZeroQuant(4+2): Redefining LLMs Quantization with a New FP6..:

Wu, Xiaoxia ; Xia, Haojun ; Youn, Stephen...
http://arxiv.org/abs/2312.08583.  , 2023
Link: http://arxiv.org/abs/231..
 
?
8

DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ..:

Yao, Zhewei ; Aminabadi, Reza Yazdani ; Ruwase, Olatunji...
http://arxiv.org/abs/2308.01320.  , 2023
Link: http://arxiv.org/abs/230..
 
?
9

DeepSpeed Inference: Enabling Efficient Inference of Transf..:

Aminabadi, Reza Yazdani ; Rajbhandari, Samyam ; Zhang, Minjia...
http://arxiv.org/abs/2207.00032.  , 2022
Link: http://arxiv.org/abs/220..
 
?
10

DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and T..:

Rajbhandari, Samyam ; Li, Conglong ; Yao, Zhewei...
http://arxiv.org/abs/2201.05596.  , 2022
Link: http://arxiv.org/abs/220..
 
?
11

Using DeepSpeed and Megatron to Train Megatron-Turing NLG 5..:

Smith, Shaden ; Patwary, Mostofa ; Norick, Brandon...
http://arxiv.org/abs/2201.11990.  , 2022
Link: http://arxiv.org/abs/220..
 
?
12

ZeroQuant: Efficient and Affordable Post-Training Quantizat..:

Yao, Zhewei ; Aminabadi, Reza Yazdani ; Zhang, Minjia...
http://arxiv.org/abs/2206.01861.  , 2022
Link: http://arxiv.org/abs/220..
 
?
13

ZeRO-Offload: Democratizing Billion-Scale Model Training:

Ren, Jie ; Rajbhandari, Samyam ; Aminabadi, Reza Yazdani...
http://arxiv.org/abs/2101.06840.  , 2021
Link: http://arxiv.org/abs/210..
 
?
14

SHARP: An adaptable, energy-efficient accelerator for recur..:

Yazdani Aminabadi, Reza ; Ruwase, Olatunji ; Zhang, Minjia...
https://dl.acm.org/doi/10.1145/3552513.  , 2023
Link: http://hdl.handle.net/21..
 
?
15

LAWS: Locality-AWare Scheme for automatic speech recognitio:

Yazdani Aminabadi, Reza ; Arnau Montañés, José María ; González Colás, Antonio María
https://ieeexplore.ieee.org/document/9080113/.  , 2020
Link: http://hdl.handle.net/21..
 
1-15