Tag: #ai-inference
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 1 posts
Running LLMs on Apple Silicon: Inside M4/M5 Architecture for AI Inference ♪ Listenable
A deep technical dive into Apple M4/M5 Unified Memory Architecture and its implications for LLM inference. Covers the Neural Engine, MLX framework, llama.cpp Metal backend, real benchmarks, and an honest comparison with
2026-03-18 · 14 min read #apple-silicon#m5#model-serving#unified-memory#mlx