LLM Inference Optimization #2: Tensor, Data & Expert Parallelism (TP, DP, EP, MoE)
20:18
LLM Inference Optimization #2: Tensor, Data & Expert Parallelism …
2.5K views5 months ago
YouTubeFaradawn Yang
How to Scale LLMs: Flash Attention, ZeRO, & Parallelism | The Engineering Behind Massive AI Models
10:36
How to Scale LLMs: Flash Attention, ZeRO, & Parallelism | The Enginee…
143 views2 months ago
YouTubeThe Savvy Scholar
Parallel-R1: Towards Parallel Thinking via Reinforcement Learning
9:12
Parallel-R1: Towards Parallel Thinking via Reinforcement Learni…
183 views5 months ago
YouTubeThe AI Layers
Ollama can run LLMs in parallel!
4:01
Ollama can run LLMs in parallel!
8.6K viewsMay 11, 2024
YouTubeLearn Data with Mark
Model Parallelism vs Data Parallelism vs Tensor Parallelism | #deeplearning #llms
6:59
Find in video from 00:17What is Model Parallelism?
Model Parallelism vs Data Parallelism vs Tensor Parallelism …
3.5K viewsApr 18, 2024
YouTubeLazy Analyst
Lecture 2: Large Language Models (LLM) Basics
33:42
Find in video from 02:05What are Large Language Models (LLMs)
Lecture 2: Large Language Models (LLM) Basics
202K viewsAug 18, 2024
YouTubeVizuara
What is LLM (Large Language Model) | Large Language Models (LLMs) Explained | LLM Models in AI
5:37
What is LLM (Large Language Model) | Large Language Models (…
7.6K views8 months ago
YouTubeRamesh Fadatare - AI & Tech
48:20
vLLM Office Hours - Distributed Inference with vLLM - January 23, …
6.2K viewsJan 29, 2025
YouTubeNeural Magic
36:12
[Picotron tutorial] Part 1: Model, Process Group Manager, Dataloader
8.9K viewsDec 20, 2024
YouTubeFerdinand Mom
24:20
Torchtitan: Large-Scale LLM Training Using Native PyTorch 3D …
1.6K viewsOct 1, 2024
YouTubePyTorch
6:20
What is LLM (Large Language Model) | How Large Language Mo…
13.8K viewsMay 13, 2024
YouTubeedureka!
4:58
LLM Agents: A Beginner’s Guide | Understanding Large Language M…
7K viewsJun 19, 2024
YouTubeAI Foundation Learning
33:39
Mastering LLM Inference Optimization From Theory to Cost …
34.9K viewsJan 1, 2025
YouTubeAI Engineer
17:52
AI Optimization Lecture 01 - Prefill vs Decode - Mastering LLM Techni…
11.4K views9 months ago
YouTubeFaradawn Yang
1:32:35
Find in video from 03:16Parallel Function Calling
Fine Tuning LLMs for Function Calling w/Pawel Garbacki
4.4K viewsJul 3, 2024
YouTubeHamel Husain
12:13
How to Efficiently Serve an LLM?
4.8K viewsAug 5, 2024
YouTubeAhmed Tremo
29:54
Distributed inference with llm-d’s “well-lit paths”
1.7K views4 months ago
YouTubeRed Hat
9:19
LLM Benchmarking | How one LLM is tested against another? | LLM E…
2.4K viewsSep 17, 2024
YouTubeSimplilearn
1:06:17
Mathematics of LLMs in Everyday Language
193.1K views8 months ago
YouTubeTuring
34:14
Understanding the LLM Inference Workload - Mark Moyou, NVIDIA
24.2K viewsOct 1, 2024
YouTubePyTorch
1:26:20
Distributed and Stable LLM Training on a Large-Scale Cluster
315 views6 months ago
YouTubeC-DAC
1:04:07
verl: Flexible and Scalable Reinforcement Learning Library fo…
5K views7 months ago
YouTubePyTorch
23:05
Multi GPU Fine Tuning of LLM using DeepSpeed and Accelerate
9.4K viewsJul 29, 2024
YouTubeAI Anytime
44:36
Your LLM Framework ONLY Needs 100 Lines (Pocket Flow)
49.6K views8 months ago
YouTubeZachary Huang
1:47:27
Stanford CME295 Transformers & LLMs | Autumn 2025 | Lecture 4 - …
62.7K views5 months ago
YouTubeStanford Online
4:57
What is Tool Calling? Connecting LLMs to Your Data
34.6K viewsJan 13, 2025
YouTubeIBM Technology
22:51
How LLMs Work: A Visual Guide
3.7K views6 months ago
YouTubeHashLips Academy
18:11
Find in video from 03:00Fully Sharded Model Parallelism
I explain Fully Sharded Data Parallel (FSDP) and pipeline parallelism in …
4K viewsFeb 8, 2024
YouTubewilliam falcon
48:36
LLM Fine-Tuning 07: LSTM vs Transformer | Why Transformers …
2.6K views9 months ago
YouTubeSunny Savita
16:04
OSDI '25 - WLB-LLM: Workload-Balanced 4D Parallelism for Large …
191 views6 months ago
YouTubeUSENIX
See more videos
Static thumbnail place holder