How LLMs Work

Learn what happens between sending a prompt and getting a reply, and how to build with it.

Kamran AhmedBy Kamran Ahmed·2h 47m·beginner

What you'll learn

  • How models split text into tokens and predict words
  • Why models make things up, and how to ground them
  • How temperature, top-p and reasoning shape replies
  • How to estimate the cost and latency of an AI feature
  • How to pick the right model by testing it on your own data
  • When a feature needs a model, and when plain code is better

Needs basic programming experience in any language

Course content

6 chapters · 45 lessons · 2h 47m total
  1. One model per task2:55
  2. Foundation models3:00
  3. From demo to product2:57
  4. AI engineer vs ML engineer2:42
  5. Five jobs models do well4:32
  6. When to use plain code instead3:04
  7. How building changes with a model2:23

About this course

Most developers now use large language models every day, but few know what happens between sending a prompt and getting a reply. This course explains how LLMs actually work, in plain language and without maths, and ties every idea back to decisions you make when you build with them.

You will see how text becomes tokens and why that drives cost and context limits, how a model predicts one token at a time and why it can't take a word back, how training shapes what models know and why they make things up, and what sampling settings and reasoning models actually change. You will then learn how to estimate cost and latency, make features feel fast, and pick the right model by testing on your own data.

Kamran Ahmed

Course by

Kamran Ahmed

Kamran is the founder of roadmap.sh. He has spent over a decade building products at startups and scale-ups, and created open-source tools used by millions of developers. He loves teaching and simplifying complex topics.

Published 2d ago

RoadmapsGuidesFAQsYouTube

roadmap.shby@nilbuild

Community created roadmaps, best practices, projects, articles, resources and journeys to help you choose your path and grow in your career.

© roadmap.sh·Terms·Privacy·

ThewNewStack

The top DevOps resource for Kubernetes, cloud-native computing, and large-scale development and deployment.