Large Language Models: How They Grew, One Problem at a Time
Draft
Preface

This is the draft of Large Language Models: How They Grew, One Problem at a Time, the companion book to Large Language Models, a free lecture course from Bluevision AI. Each chapter covers a run of consecutive lectures, and each section covers one lecture: section 1.1 is Session 01, and so on. The lectures give each idea as a picture and in speech; this book gives the full argument, the references and the exercises.
The title names the method of the book, which we call the problem chain. Each section starts from a problem that the previous section left open, solves it, and ends on the new problem that the solution creates. Language is hard for a machine to represent, so we turn words into vectors. Vectors ignore word order, so we read text as a sequence. Recurrent networks forget the start of a long sequence, so we add attention. Attention on its own becomes the Transformer, and the chain continues through scale, alignment, efficiency and the limits of what these models can be trusted to do. The chain follows, roughly, the order in which the field itself grew, so it is also a short history of how large language models came to be.
About this draft
This is a review draft. Every section has been checked for facts, mathematics and references, and tested on readers new to the subject, but it has not yet been through outside review. If you find an error, or a passage that does not make sense, please use the Report an issue link on the page; a free GitHub account is enough. Corrections are fixed in the online edition. Errors in the published lecture videos are listed on the Errata page.
How to cite this book
Cite the book, or the chapter you used. Please do not cite the videos: they point here.
Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft). Bluevision AI. https://books.bluevision-ai.org/LLM/
@misc{seydi2026LLM,
author = {Seydi, Vahid},
title = {Large Language Models: How They Grew, One Problem at a Time},
year = {2026},
note = {Draft},
publisher = {Bluevision AI},
url = {https://books.bluevision-ai.org/LLM/}
}To cite one chapter:
- Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft), Chapter 1: Representing Language. Bluevision AI. https://books.bluevision-ai.org/LLM/
- Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft), Chapter 2: Sequences and Attention. Bluevision AI. https://books.bluevision-ai.org/LLM/
- Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft), Chapter 3: The Transformer and Its Descendants. Bluevision AI. https://books.bluevision-ai.org/LLM/
- Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft), Chapter 4: Scale. Bluevision AI. https://books.bluevision-ai.org/LLM/
- Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft), Chapter 5: Training, Alignment and Efficiency. Bluevision AI. https://books.bluevision-ai.org/LLM/
- Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft), Chapter 6: Using a Frozen Model. Bluevision AI. https://books.bluevision-ai.org/LLM/
- Seydi, V. (2026). Large Language Models: How They Grew, One Problem at a Time (draft), Chapter 7: Trust and Its Limits. Bluevision AI. https://books.bluevision-ai.org/LLM/