hackertube.io

Attention Is All You Need

Yannic Kilcher · explainer · Watch on YouTube

LLMs & generative AIMachine learning & deep learning

What it is

Yannic Kilcher walks through the Attention Is All You Need paper, which introduced the Transformer, a sequence model based solely on attention without recurrence or convolutions. He reviews the architecture and the paper's translation results.

Why Hacker News recommends it

HN recommends it as an accessible, clear walkthrough of the transformer paper for people with some AI background.

  • 4 people recommended it
  • 4 different months
  • 1 strong recommendations
  • first 2020, last 2025

What HN commenters said

  1. “I find the channel amazing explaining super complex topics in simple enough terms for people who have some background in AI.”

    Detailed, simple explanation of the transformer paper

    bfung, 2023-01 · Strong recommendation · in “The Transformer Family”

  2. “for the theory bit you may find Yannic Kilcher's videos [0,1] helpful”

    Video walkthrough of the Attention paper theory

    kanche, 2020-10 · Recommendation · in “Rethinking Attention with Performers”

  3. “For accessibility I recommend Yannic Kilcher video review of”

    Accessible review of the Attention Is All You Need paper

    visarga, 2021-12 · Recommendation · in “The potential of transformers in reinforcement learning”

  4. “The Yannic kilcher review is quite good.”

    Good review explaining transformers and attention

    throwawaymaths, 2023-05 · Recommendation · in “Ask HN: Can someone ELI5 Transformers and the “Attention is all we need” paper”

Excerpts from Hacker News comments, linked to the originals. Summaries and labels were written by a language model from those comments.

Topics: transformers, attention, paper review, deep learning, nlp, yannic kilcher

Also recommended by the same people