Air Audio vs MLX Benchmarks

Save tunes from any streaming music service into Air Audio's own library of itemized music by title, artist and album names. Instantly create playlists and play audio on your iPhone, iPad or Apple silicon Macs including internal speakers, wireless or wired ear buds or any Airplay device in your home.

MLX Benchmark measures how fast large language models run on your iPhone and iPad, entirely on device, with Apple's open-source MLX framework. STANDARD BENCHMARK Every device runs the same test: a fixed 512-token prompt, then exactly 128 tokens generated with greedy decoding. One warm-up run and three measured runs, with medians reported. Because the input and settings never change, your results are directly comparable with any other device. COMMUNITY Share your standard runs anonymously and compare your device with everyone else's: • Device ranking: median generation speed, prefill speed or time to first token for each model • Models on a device: how speed changes with model size, next to the memory-bandwidth estimate for that device • Comparison: your run next to the community medians of other devices DETAILED MEASUREMENTS • Generation and prefill speed, in tokens per second • Time to first token, tokenization and model load time • Per-token latency as a timeline and a distribution, with P50, P95, P99 and jitter • Memory: model weights, KV cache and activations, and the peak against the memory iOS lets the app use • Thermal state and Low Power Mode, so throttled runs are easy to spot MODELS Browse a catalog of open models supported by MLX, such as Qwen and Llama in 4-bit. Each model is downloaded on its first run; see what is stored on your device and delete what you no longer need. CUSTOM RUNS Try your own prompt, generation length and number of iterations. Custom results stay on your device. PRIVACY No account and no tracking. Only standard runs are shared, and only while sharing is on: device model and hardware (core counts, memory), the model tested, app and OS version, and the measured metrics. Nothing that identifies you.