Using the LLM as a Query Planner
14 Jul 2026In my thesis work the model only routes questions to the right data partition and pushes predicates down to PostGIS and Neo4j. Inference token cost dropped 3x and routing-index quality ended up deciding answer accuracy.