Nexus LLM vs MLX Benchmarks

Nexus LLM: Your Hub for Connecting and Customizing LLMs Nexus LLM brings all your favorite large language models into one seamless, powerful chat app. Easily connect with Ollama, and JanAI via their APIs, enabling access to each service’s full suite of models—all in one place. With Nexus, you can create custom Assistants tailored to your needs, fine-tuning models for personalized interactions. For enhanced privacy, Nexus also supports self-hosted instances of Ollama and JanAI, providing secure, local access to LLMs. Enjoy a clean, modern UI that supports Markdown for formatting, including tables, code blocks, and other essentials, making your chat experience as clear and organized as possible.

MLX Benchmark helps you understand how large language models perform on your hardware. Select a model and quantization, set context length and iterations, and run repeatable benchmarks that capture load time, tokenization time, time to first token, throughput, memory usage, and jitter. View detailed metrics grids, visualize comparisons in charts, and manage downloaded model repos directly in the app. Built for developers and AI enthusiasts who want clear, on-device performance insights without leaving their device. Features: - Model selection with quantization details - Configurable prompt, context length, and iterations - Metrics for load, tokenization, first-token latency, throughput, jitter, and memory - Charts to compare runs and devices - Downloaded model management (list, delete, refresh) - Optional Supabase upload for aggregating benchmark results