Skip to main content

12. Hardware sizing

ProfileHardwareModelsNotes
Production, up to about 5k invoices a monthOne 48 GB GPU (L40S class)Qwen3.8-27B FP8 plus Qwen3-Embedding-0.6B on the same cardA vendor write-up (Uvik Software) reports the FP8 build fits a single 48 GB card. Treat as indicative
Production, higher volumeTwo 80 GB GPUs or four GPUs in tensor-parallelQwen3.8-27B full precision, long contextMonth-end batch peaks
BudgetTwo 24 GB consumer GPUsQwen3.8-27B AWQ 4-bitCommunity quantizations inherit Apache-2.0, but verify each repository
CPU-only, development16–32 GB RAMQwen3-8B or gpt-oss-20b, embeddings on CPU, Docling on CPUSlow but fully open source. Development and CI only

Docling's layout model is small and runs acceptably on CPU. Give docling-serve 4–8 vCPU. Model choice is a one-line change in models.yaml.