#On-prem AI

2 posts on On-prem AI.

13 Oct 2026· 2 min read
FinOps-Estimator: sizing GPUs for a voice AI pipeline
An open-source tool that turns concurrency and model choices for STT → LLM → TTS into VRAM, RAM, CPU, TFLOPS and cloud or on-prem cost.
On-prem AI LLM serving Open source
13 Oct 2026· 6 min read
Fitting an LLM in your own server room: the memory math behind on-prem AI
Bits per weight, quantization error, outliers, KV cache and memory bandwidth: how to decide which model actually runs on the GPUs you own.
On-prem AI Quantization LLM serving

FinOps-Estimator: sizing GPUs for a voice AI pipeline