Superficial Drive

Superficial Drive

Llava

Paper Summary

Vistion Transformer

Paper Summary

Attention Is All You Need

Paper Summary

Roformer Enhanced Transformer With Rotary Position Embedding

Paper Summary

From zero to insight.

LLM positional embedding transformers MiniMind tokenizer BPE LayerNorm RMSNorm RoPE

LLM Deep Dive 4: Normalization (LayerNorm vs RMSNorm) in MiniMind LLM Deep Dive 3: Rotary Positional Embedding with MiniMind LLM Deep Dive 2: Positional Embedding LLM Deep Dive 1: Tokenizer Engineering with MiniMind

Copyright 2025