Tag: #token-pruning
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Multimodal Tokenization and Fusion — Turning Images and Audio Into Tokens
A deep look at how images, audio, and video become tokens and get woven into one sequence with text. We cover patch and VQ image tokenization, discrete-codec audio tokenization, frame sampling, interleaving and separator
2026-06-26 · 14 min read #llm#multimodal#tokenization#vision-language#q-former