Infrastructure vs. Models
Semantic Chunking for Document RAG Pipelines
Bad chunk boundaries tank RAG accuracy more than model choice.
Callum Ferris
· 11 min read
Bad chunk boundaries tank RAG accuracy more than model choice.
Hallucinations that pass validation checks pose bigger risks than raw accuracy metrics reveal.
Regulators demand accountability at every step of document processing, not just faster data capture.
Standardized testing reveals why vendor accuracy claims aren't comparable.
Two competing architectures determine which vendor succeeds on scanned PDFs.
Accuracy and engineering time, not license fees, determine which tool wins.
Spatial reasoning problems favor specialist document AI over scaled general models.
Most vendors stop at extraction, leaving the layers that determine production reliability unbuilt.