LLM Bench vs Sidecar ML

LLM Bench is an iOS test bench for developers comparing on-device LLM behavior under real device constraints. Run the same prompt against selected local model targets and compare the evidence before choosing what belongs in your app. LLM Bench focuses on practical signals: load time, first output time, generation time, output speed, memory, thermal state, model readiness, raw output text, failures, and saved run history. Use LLM Bench to: - Compare GPU-capable local model runs on iPhone and iPad. - Run repeatable prompts against selected model targets. - Inspect model output, timing, memory, and thermal state in one place. - Save benchmark runs for later review. - Export benchmark evidence as CSV. - Add models from Hugging Face URLs, direct file URLs, or local imports when the artifact format is supported. LLM Bench is built for technical builders who want a compact measurement tool, not a leaderboard or generic AI chat app. It helps you answer the practical question: which local model behaves well enough on this device for this use case? The free tier includes one completed benchmark run. Subscribing unlocks ongoing benchmarking, saved comparison work, and export workflows. Premium is available as an auto-renewing subscription (monthly or yearly), or a one-time Lifetime purchase. Payment is charged to your Apple ID at purchase; subscriptions renew automatically unless canceled at least 24 hours before the period ends. Manage or cancel anytime in your App Store account settings. Privacy Policy: https://thedandano.github.io/michilotl-studios-docs/apps/llm-bench/privacy/ Terms of Use (EULA): https://www.apple.com/legal/internet-services/itunes/dev/stdeula/

Turn your iPhone into a private, on-device AI server for your whole network. Sidecar ML runs a lightweight HTTP server on your iPhone that exposes Apple's built-in machine-learning models to any device on your local network. Tap Start Server, scan the QR code, and your Mac, PC, Raspberry Pi, or browser can call powerful on-device AI over plain REST — no cloud, no accounts, no API keys, no usage fees, and no data leaving your network. Everything runs on the phone. Nothing is uploaded to a server and there's nothing to pay for. (The one exception, music recognition, matches against Apple's catalog and tells you so up front.) ONE IPHONE, A DOZEN AI CAPABILITIES • Chat with the on-device large language model through a chat-completions endpoint that's compatible with the popular OpenAI API format — streaming, JSON mode, and structured output included. Point existing tools and SDKs at your phone and they just work. • Generate images from a text prompt in a choice of art styles. • OCR — pull text out of photos, receipts, and screenshots with per-line boxes and multi-language support. • Read barcodes and QR codes (EAN, Code128, and more). • Classify images across roughly a thousand categories, or produce image embeddings for similarity search. • Remove backgrounds and isolate subjects or people as clean PNG cut-outs. • Detect faces and facial landmarks, body pose, and hand pose. • Scan documents with automatic edge detection and perspective correction. • Convert speech to text and text to speech, with a wide range of voices (including Personal Voice). • Translate text between languages completely offline. • Analyse text: language, sentiment, named entities, tokens, and embeddings. • Classify sounds across hundreds of categories, or identify the music that's playing. BUILT FOR DEVELOPERS AND MAKERS • Clean REST + Server-Sent Events API — call it from curl, Python, JavaScript, or any HTTP client. • Chat endpoint compatible with the OpenAI format, so many existing tools and SDKs work unchanged. • Automatic discovery on your network via Bonjour. • Honest capability reporting: ask the server what it can do and it tells you exactly what's available on your device, and why. • Optional bearer-token authentication to lock the server down on shared networks. FREE WEB CONSOLE AND CODE EXAMPLES A ready-to-use web console — plus Python examples, a command-line client, and full API documentation — is free and open-source. Download the single-file console and browse the source here: https://github.com/AndersFB/Sidecar-ML-Console/ Open the console in any browser, enter your phone's address, and try every capability with a friendly UI — nothing to install. GOOD TO KNOW • The on-device large language model and image generation require an Apple Intelligence-capable iPhone. The other capabilities run on a much wider range of devices. • The server runs while the app is in the foreground; a keep-awake option helps during longer sessions. • Some features (offline translation language pairs and certain speech models) download their models on first use. Turn the iPhone in your pocket into a private AI endpoint for your projects, your home lab, and your prototypes — Sidecar ML.