MLX Benchmarks vs Secretwell

MLX Benchmark measures how fast large language models run on your iPhone and iPad, entirely on device, with Apple's open-source MLX framework. STANDARD BENCHMARK Every device runs the same test: a fixed 512-token prompt, then exactly 128 tokens generated with greedy decoding. One warm-up run and three measured runs, with medians reported. Because the input and settings never change, your results are directly comparable with any other device. COMMUNITY Share your standard runs anonymously and compare your device with everyone else's: • Device ranking: median generation speed, prefill speed or time to first token for each model • Models on a device: how speed changes with model size, next to the memory-bandwidth estimate for that device • Comparison: your run next to the community medians of other devices DETAILED MEASUREMENTS • Generation and prefill speed, in tokens per second • Time to first token, tokenization and model load time • Per-token latency as a timeline and a distribution, with P50, P95, P99 and jitter • Memory: model weights, KV cache and activations, and the peak against the memory iOS lets the app use • Thermal state and Low Power Mode, so throttled runs are easy to spot MODELS Browse a catalog of open models supported by MLX, such as Qwen and Llama in 4-bit. Each model is downloaded on its first run; see what is stored on your device and delete what you no longer need. CUSTOM RUNS Try your own prompt, generation length and number of iterations. Custom results stay on your device. PRIVACY No account and no tracking. Only standard runs are shared, and only while sharing is on: device model and hardware (core counts, memory), the model tested, app and OS version, and the measured metrics. Nothing that identifies you.

Secretwell is a private, native iOS client for OpenBao. Connect directly to your OpenBao servers and namespaces over HTTPS. Browse KV v1 and KV v2 secrets, inspect version history, manage values within your permissions, review policies, and check server and audit posture from your iPhone. Built for least-privilege access: • OpenBao Token, Wrapped Token, Username & Password, LDAP, RADIUS, Signed JWT, JWT CEL, OIDC, and Kubernetes authentication • Supported TOTP MFA verification • Multiple servers and namespaces • Permission-aware actions and locked states • Face ID protection and device-only Keychain storage • Secret values concealed until you reveal or copy them • Light and dark appearance Secretwell connects your iPhone directly to the OpenBao server you choose. It has no account service, product analytics, ads, tracking, crash reports, session replays, or remote logs. Apple and RevenueCat process anonymous purchase information to provide Secretwell Pro. Secretwell is an independent client for OpenBao. It is not affiliated with or endorsed by OpenBao, OpenSSF, the Linux Foundation, or LF Projects. Terms of Use (EULA): https://www.apple.com/legal/internet-services/itunes/dev/stdeula/