Tag: #local-ai
Writing on GPUs, LLMs, MLOps, Kubernetes — and mindset · 3 posts
tts-bench: comparing local TTS models when quality is subjective
tts-bench is a local benchmark by 5uck1ess for comparing 55 text-to-speech models on hardware you own. It splits evaluation into three lenses: Speed (TTFA, RTF, memory), Listen (every model on every prompt, judged by ear
2026-07-11 · 5 min read #tts#text-to-speech#benchmark#local-ai#evaluationLocal AI & On-Device LLMs 2026 — Ollama · LM Studio · Jan · Msty · Open WebUI · GPT4All · AnythingLLM · Faraday Deep Dive ♪ Listenable
By May 2026, local AI is no longer a hobby. An M4 Max MacBook Pro runs Llama 4 Scout 109B MoE at 24 tokens per second. Desktop runtimes like Ollama, LM Studio, Jan, and Msty unify GUI and CLI, while Open WebUI, AnythingL
2026-05-16 · 23 min read #local-ai#on-device-llm#ollama#lm-studio#janAI Supercomputer at Home: Study LLMs on NVIDIA DGX Spark and Create Content with ComfyUI ♪ Listenable
Run 200B-parameter LLMs locally on NVIDIA DGX Spark ($3,999) and generate FLUX/SDXL images with ComfyUI. Complete guide with specs, benchmarks, setup instructions, and cost analysis — the era of personal AI supercomputer
2026-03-21 · 37 min read #nvidia#dgx-spark#comfyui#local-ai#llm