Benchmarks

Real device performance

Aggregate benchmarks from the Octomil community. All data is anonymized and averaged across submissions.

Model Quant Runtime Platform Chip GPU RAM tok/s TTFT ms TPOT ms/tok Runs
Run browser benchmark Run on your device