Han's Generative AI Quest

Chronicling my journey through language models, from scratch.

HOME
CATEGORIES
TAGS
ARCHIVES
ABOUT

Home Tags encoder-decoder

Tag

encoder-decoder 1

Study Notes: Stanford CS336 Language Modeling from Scratch [6] Sep 17, 2025

Recently Updated

LLM Architecture Refresh [5]: Mixture-of-Experts, and Why Sparsity Doesn't Survive a Batch
LLM Architecture Refresh [4]: Quantization, and Why Perplexity Won't Tell You It Broke
LLM Architecture Refresh [3]: Flash Attention Is Exact, and Here's the Proof
LLM Architecture Refresh [2]: The KV Cache, and Why Decode Is Memory-Bound
LLM Architecture Refresh [1]: Inside a Transformer Block — Attention, Heads, and the FFN

Trending Tags

peppercarrot portfolio cs336 fastapi ollama pytorch rag chromadb claude-skills claude

© 2026 Han Yu. Some rights reserved.

Using the Chirpy theme for Jekyll.

Trending Tags

peppercarrot portfolio cs336 fastapi ollama pytorch rag chromadb claude-skills claude