Run locally
Validate the local path on your own hardware before you commit to rollout policy.
Open local setupOctomil packages one model path across CoreML, LiteRT, MLX, ONNX, and browser runtimes, releases it by device cohort with holds and rollback, and falls back to cloud only when the device cannot deliver. Inference that stays on-device is never metered.
Free while traffic stays on-device. First response in under five minutes. Need a walkthrough instead? Request a demo.
import com.octomil.sdk.Octomil
val client = Octomil(publishableKey = "oct_p12....")
client.initialize()
val response = client.responses.create(
model = "gemma3-1b",
input = "What's the capital of Canada?"
)
println(response.outputText)> The capital of Canada is Ottawa.Use the route that matches where your team is today.
Validate the local path on your own hardware before you commit to rollout policy.
Open local setupWhere Octomil fits against cloud gateways like OpenRouter and LiteLLM, and where it does not.
Read the comparisonsThe same meter that runs in production: what your traffic costs through Octomil versus all-cloud.
Open the savings calculatorRuntime preference, device targeting, rollout state, and fallback rules live in one place, so what ships to which cohort is inspectable rather than buried in client code.
Example policy fields for a routine mobile cohort.
Package once, release by cohort, and keep the production path legible.
One packaging path across CoreML, LiteRT, MLX, ONNX, and browser runtimes.
Roll out by cohort, hold changes, and roll back without rebuilding the model path.
Keep routine inference local and use cloud only when hardware or quality requires it.
When procurement, privacy, or security requirements show up, the platform should still feel manageable.
Support for SSO, SCIM, scoped access, and audit history.
VPC and privacy-sensitive deployment options when review requirements show up.
Security materials, deployment planning, and rollout review support.
Grab a key, point the SDK at a small model, and watch the router keep it on-device. When procurement or rollout planning shows up, we will walk through your actual workload.