transformers - Superficial Drive

Superficial Drive

Viewing articles under the transformers

Oct 26, 2025 LLM Deep Dive 2: Positional Embedding

From zero to insight.

LLM positional embedding transformers MiniMind tokenizer BPE LayerNorm RMSNorm RoPE

LLM Deep Dive 4: Normalization (LayerNorm vs RMSNorm) in MiniMind LLM Deep Dive 3: Rotary Positional Embedding with MiniMind LLM Deep Dive 2: Positional Embedding LLM Deep Dive 1: Tokenizer Engineering with MiniMind

Copyright 2025