ML Performance Reading Group Session 8: Megatron-LM
1:09:21
ML Performance Reading Group Session 8: Megatron-LM
958 viewsMar 10, 2025
YouTubeEleutherAI
MegaScope: visualize the LLM training process of Megatron-LM
6:47
MegaScope: visualize the LLM training process of Megatron-LM
43 views4 months ago
YouTubeOpenSQZ
Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM | Jared Casper
24:04
Efficient Large-Scale Language Model Training on GPU Clusters U…
7.7K viewsOct 27, 2023
YouTube@Scale
Efficient large-scale language model training on GPU clusters using megatron-LM | Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
Efficient large-scale language model training on GPU clusters using me…
Oct 30, 2021
acm.org
Efficient large-scale language model training on GPU clusters using megatron-LM | Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis
Efficient large-scale language model training on GPU clusters using me…
Nov 13, 2021
acm.org
Announcing Megatron for Training Trillion Parameter Models and NVIDIA Riva Availability | NVIDIA Technical Blog
Announcing Megatron for Training Trillion Parameter Models and NVI…
Apr 12, 2021
nvidia.com
大语言模型基础之从零到一实现之路 L15：LLM进阶之分布式并行(基于Megatron-LM) [2025南京大学计算机学院选修课]
1:34:03
大语言模型基础之从零到一实现之路 L15：LLM进阶之分布式并行(基于Me…
2.1K views2 months ago
bilibiliPar4g0N
21:00
第十一课：MindSpore Transformers & Megatron-LM 训练精度对比 | 大 …
447 views3 months ago
bilibiliMindSpore官方
20:04
分布式训练框架Megatron-LM代码概览 #大模型 #分布式并行 #训练 #大模型 …
1 month ago
YouTubeZOMI酱
22:06
Megatron-LM 张量并行 TP 代码剖析 #大模型训练 #分布式训练 #大模型 …
1 month ago
YouTubeZOMI酱
1:55:49
「小型LlamaモデルのMegatron-LMを用いた事前学習と継続事前学習」 …
1.3K viewsOct 28, 2024
YouTube東京大学 松尾・岩澤研究室
10:31
[LLM训练] Megatron-LM里的张量并行：Attention、FFN和Embedding全 …
1.6K views11 months ago
bilibili我是小小升
21:22
Accelerating Model Development and Fine-Tuning on Databricks wit…
307 views8 months ago
YouTubeDatabricks
22:14
Megatron-LM 序列并行 SP 代码剖析 #大模型 #分布式并行 #大模型 #分 …
1 month ago
YouTubeZOMI酱
55:10
Megatron-LM技术讲解
3.7K viewsFeb 18, 2024
bilibilipoker125
19:33
Megatron-LM 流水并行PP代码解析 #大模型 #分布式并行 #分布式训练
377 viewsJun 3, 2024
YouTubeZOMI酱
7:27
Megatron - LM
8 views1 month ago
YouTube彭德懷
56:07
Megatron LM 论文精读【论文精读】
4.2K viewsJun 9, 2022
YouTube跟李沐学AI
19:39
Megatron-LM张量并行的行切分和列切分核心原理 #大模型 #分布式并行 …
8.7K viewsMay 13, 2024
bilibiliZOMI酱
39:42
DeepSpeed: All the tricks to scale to gigantic models
24.5K viewsApr 17, 2021
YouTubeMark Saroufim
1:01:11
GTC 2020: Megatron-LM
63 viewsFeb 20, 2025
bilibilierbaolaa
1:22:58
Ultimate Guide To Scaling ML Models Megatron-LM | ZeRO | Dee…
535 viewsAug 25, 2022
bilibili人工智能基地2
1:22:34
Ultimate Guide To Scaling ML Models - Megatron-LM _ ZeRO _ D…
312 viewsFeb 17, 2023
bilibilibackyess
11:32
Running GPT-3 Models with NVIDIA® NeMo Megatron on Azure
4.2K viewsMar 10, 2023
YouTubeMicrosoft Azure
1:26:20
Distributed and Stable LLM Training on a Large-Scale Cluster
295 views6 months ago
YouTubeC-DAC
1:00
b7® on TikTok
608.3K views2 months ago
TikTok___b7___
16:26
NSDI '24 - MegaScale: Scaling Large Language Model Training to More …
828 viewsJun 4, 2024
YouTubeUSENIX
The One and Only Decepticons Leader .... #megatron #megatrone…
130.8K viewsJan 10, 2025
TikTok_den999_
Ganhando Com Megatronn: Estratégia e Domínio na Rota Top
115.4K viewsFeb 19, 2023
TikTokcinder1705
See more videos
Static thumbnail place holder