Tag: #LLM 추론
Kubernetes, DevOps and MLOps, written from things we ran and measured ourselves · 1 posts
Real-time voice conversation, measured latency by component: ASR 0.2s, LLM first token 0.07s, TTS half the length
We directly measured the three components (ASR, conversational LLM, TTS) of real-time voice conversation for foreign language speaking practice in Korean, Japanese, Chinese, and English. We break down the component-wise
2026-10-07 · 30 min read #음성 에이전트#ASR#TTS#지연 측정#LLM 추론