Wayfinder Router: Open-Source Offline LLM Query Router Trends on Hacker News
Wayfinder Router (Apache-2.0, Python) is a CLI tool that routes LLM queries between local models (Ollama, vLLM) and hosted APIs (OpenAI, Claude, Gemini, OpenAI-compatible endpoints) without making a model call for the routing decision. It scores prompt structural complexity on a 0–1 scale offline in under 1ms, dispatching low-complexity queries to local models and high-complexity ones to hosted APIs. It exposes an OpenAI-compatible gateway so callers need not change client code. The project reached 115 points on Hacker News on June 28.
Why it matters
Offline sub-millisecond routing between local and cloud LLMs addresses a real cost-optimization problem: run cheap local models for simple prompts, escalate to frontier APIs only when needed. The OpenAI-compatible gateway allows drop-in adoption.
Importance: 2/5
Community tool trending on HN (115 pts); pragmatic solution to local/cloud LLM cost routing with no inference overhead