Torrent details for "Grigorov D. Building Large Language Models from Scratch...LLMs w…" Log in to bookmark
Controls:
×
Report Torrent
Please select a reason for reporting this torrent:
Your report will be reviewed by our moderation team.
×
Report Information
Loading report information...
This torrent has been reported 0 times.
Report Summary:
| User | Reason | Date |
|---|
Failed to load report information.
×
Success
Your report has been submitted successfully.
Checked by:
Category:
Language:
None
Total Size:
64.0 MB
Info Hash:
DDFC61423680048152446BFB91BB7B0A84E9CFBE
Added By:
Added:
April 28, 2026, 10:43 a.m.
Stats:
|
(Last updated: April 28, 2026, 10:44 a.m.)
| File | Size |
|---|---|
| Singh B. Building Applications with Large Language Models...2024.pdf | 18.0 MB |
| Grigorov D. Building Large Language Models from Scratch...LLMs with PyTorch 2026.pdf | 20.7 MB |
| Singh B._Code .zip | 25.4 MB |
Name
DL
Uploader
Size
S/L
Added
-
13.6 MB
[17
/
3]
2024-10-25
| Uploaded by indexFroggy | Size 13.6 MB | Health [ 17 /3 ] | Added 2024-10-25 |
-
20.4 MB
[35
/
32]
2025-07-02
| Uploaded by andryold1 | Size 20.4 MB | Health [ 35 /32 ] | Added 2025-07-02 |
NOTE
SOURCE: Grigorov D. Building Large Language Models from Scratch...LLMs with PyTorch 2026
-----------------------------------------------------------------------------------
COVER
-----------------------------------------------------------------------------------
MEDIAINFO
Textbook in PDF format This book is a complete, hands-on guide to designing, training, and deploying your own Large Language Models (LLMs)—from the foundations of tokenization to the advanced stages of fine-tuning and reinforcement learning. Written for developers, data scientists, and AI practitioners, it bridges core principles and state-of-the-art techniques, offering a rare, transparent look at how modern transformers truly work beneath the surface. Starting from the essentials, you’ll learn how to set up your environment with Python and PyTorch, manage datasets, and implement critical fundamentals such as tensors, embeddings, and gradient descent. You’ll then progress through the architectural heart of modern models, covering RMS normalization, rotary positional embeddings (RoPE), scaled dot-product attention, Grouped Query Attention (GQA), Mixture of Experts (MoE), and SwiGLU activations, each explored in depth and built step by step in code. As you advance, the book introduces custom CUDA kernel integration, teaching you how to optimize key components for speed and memory efficiency at the GPU level—an essential skill for scaling real-world LLMs. You’ll also gain mastery over the phases of training that define today’s leading models Pretraining - Building general linguistic and semantic understanding. Midtraining - Expanding domain-specific capabilities and adaptability. Supervised Fine-Tuning (SFT) - Aligning behavior with curated, task-driven data. Reinforcement Learning from Human Feedback (RLHF) - Refining responses through reward-based optimization for human alignment. The final chapters guide you through dataset preparation, filtering, deduplication, and training optimization, culminating in model evaluation and real-world prompting with a custom TokenGenerator for text generation and inference. By the end of this book, you’ll have the knowledge and confidence to architect, train, and deploy your own transformer-based models, equipped with both the theoretical depth and practical expertise to innovate in the rapidly evolving world of AI. What You’ll Learn How to configure and optimize your development environment using PyTorch The mechanics of tokenization, embeddings, normalization, and attention mechanisms. How to implement transformer components like RMSNorm, RoPE, GQA, MoE, and SwiGLU from scratch. How to integrate custom CUDA kernels to accelerate transformer computations. The full LLM training pipeline: pretraining, midtraining, supervised fine-tuning, and RLHF. Techniques for dataset preparation, deduplication, model debugging, and GPU memory management. How to train, evaluate, and deploy a complete GPT-like architecture for real-world tasks
×