TrustedRouter: one API, all the LLMs, provably private

3 min read
by Joseph Perla
#trustedrouter#ai#llms#privacy

TrustedRouter is one API, all the LLMs, provably private.

The basic idea is simple: one drop-in replacement for your existing LLM API calls, and suddenly you can route to any model, keep uptime high, fall back automatically, and run cheaper models where they're good enough. Engineers want this. The problem is they've been using OpenRouter for months but only for the non-sensitive stuff, because they can't actually verify what OpenRouter is doing with their prompts. So a whole class of use cases never gets a router at all.

TrustedRouter fixes this with two things together. First, every piece of the backend — the infrastructure, the configuration, the bring-up scripts, the UI — is entirely open source. Second, it runs in a secure enclave, so you can cryptographically attest what code is actually executing when you connect, and continuously while you stay connected. You don't have to take our word for it. You can check.

OpenRouter also lets you swap between models. But you have no real idea what it's doing with your prompt in transit. You can't audit it. With TrustedRouter, you know end to end what's running, and you can prove it. That's the difference that matters when you're putting sensitive data through a third-party router.

I've talked to a lot of engineers who said basically the same thing: they'd love to run more traffic through a router, but they don't trust the security story, so they don't. Now there's an open source, enclave-attested, API-compatible drop-in that they can run themselves on their own hardware, run internally, or run hosted. The whole point is that anyone can take this and run it. Proliferation is the goal — we want a world where verified, private LLM routers are everywhere, not one where you have to trust a black box.

I've been working toward democratizing access to AI for about 20 years, going back to the DARPA Grand Challenge self-driving car project at Princeton and through my PhD in AI. The centralizing trend we're seeing right now is genuinely concerning, and I think open source tooling with cryptographically verifiable security is one of the real answers to it. Confidential computing and secure enclaves are a powerful and underused tool, and routing your LLM calls is a great place to start using them.

TrustedRouter is live now.

More on TrustedRouter

TrustedRouter — one API, all the LLMs, provably private.

Enjoyed this essay?

Follow me for more insights on technology, startups, and the future.