Real device performance

Aggregate benchmarks from the Octomil community. All data is anonymized and averaged across submissions.

ModelQuantRuntimePlatformChipGPURAMtok/sTTFT msTPOT ms/tokRuns