Superficial Drive

Superficial Drive

From zero to insight.

LLM positional embedding transformers MiniMind tokenizer BPE LayerNorm RMSNorm RoPE

LLM Deep Dive 4: Normalization (LayerNorm vs RMSNorm) in MiniMind LLM Deep Dive 3: Rotary Positional Embedding with MiniMind LLM Deep Dive 2: Positional Embedding LLM Deep Dive 1: Tokenizer Engineering with MiniMind

Copyright 2025