OfflineLLM vs NETTRASH.md

OfflineLLM uses a custom execution engine for LLMs, optimised specifically for Apple Silicon on iPhone, iPad, Mac and Vision Pro. Using the full power of Metal 3, OfflineLLM is able to run faster on consumer devices than apps based on llama.cpp and MLC. Welcome to AI chatbots that can be used without the risk of compromising confidential and sensitive data. For the first time, you can have personal GPT assistants running privately on your device without an Internet connection. No data is ever sent to the cloud. Your conversations never leave your device. Continue using your AI chatbots when in Airplane mode. Chat directly with the LLM that powers Apple Intelligence! Experience multi-modal vision models like never before on the iPhone. Send images to your offline AI chatbots. Further enhance your AI chatbots using RAG (Retrieval Augmented Generation) to integrate your own documents and files into your LLMs. Beginner mode allows novices to step into the world of LLMs and AI chatbots. Advanced mode allows experts to configure every parameter of the LLM execution engine. Interact with Offline LLM, anywhere and on any device. Extend the app with system Shortcuts, Automations and Widgets. Have other tools? Use our OpenAI-compatible API to integrate with other systems. Use state-of-the-art AI models, such as DeepSeek, Llama or Gemma to privately answer any questions you may have. Offline LLM supports any GGUF model, including: - GPT-OSS - DeepSeek - Llama - Gemma - Phi - Mistral - ORCA - MobileVLM - StableLM - Code Llama - VisionLlama - TinyLlama - OpenHermes - WizardLM - RWKV Whether you are getting ready for an important presentation, a copywriter looking for a clever turn of phrase, or a student needing to summarise a large article of text for an essay, an AI chatbot can help you. Offline LLM can be your personal AI assistant. AI Writing Assistant: Get personalised help from your AI chatbot. Draft anything from emails and speeches to lyrics and poems. Grammar and Spelling Checker: Using the fastest GPT on the App Store, quickly check and correct your grammar, spelling and function. Professional Proofreading and Rewriting: Use AI to proofread and rewrite your text to make it more engaging, coherent and professional. Summarise Text: Let your personalised AI assistant read large articles of text and summarise them neatly and concisely so that you can quickly understand large chunks of information in record time. Personal Tutor: Learn any concept quickly and easily. Ask your GPT tutor to explain any concept for you to learn in record time. Tackle homework and assignments with ease and get top marks. Coding Assistant: Your personalised AI coding assistant. Get help programming in any language, including Python, JavaScript, TypeScript, Java, Swift, Kotlin, PHP, Go, C/C++, Haskell, Perl, Ruby, Rust, C# and more. Write efficient and reliable production code in record time with the help of AI. Learn Languages: Learn any language with the help of a fluent AI chatbot. Master any language in record time. Ultimate Creativity Expert: Get instant creativity at your fingertips with the help of an AI creative. Impress others with your newfound creativity. AI Friend: Chat with a companion 24/7 with access to an AI chatbot. Quick answers in real-time to all of your messages. No more being left on blue ticks. Gourmet Chef: Get delicious food recipes and meal inspiration from an AI expert. Offline LLM can run a variety of models, which are capable of running on a range of devices. Performance on devices will vary and depend on the model selected. More advanced models are optimized for powerful Macs and iPads and will struggle to run on older iPhones. To successfully run a model, your device must have more VRAM than the model you choose to use. Large language models perform differently for each question asked; some questions will run significantly quicker or slower than others.

md is a Markdown editor and live previewer for iPhone and iPad. Write plain Markdown, watch the finished page take shape as you type, then print it, export it, or turn a folder of chapters into a whole book. WRITE AND SEE • Edit and Preview on iPhone; on iPad, a Split view puts the source and the rendered page side by side — and the two panes scroll as one, so the passage you are reading is the paragraph you are writing. • The preview is the printed page: one renderer draws the preview, the printout and the PDF — the same layout, set for paper. • Headings, lists, task lists, tables, quotes, code, links and images — plus footnotes, and metadata front matter (YAML or TOML) recognised and kept out of the page. • LaTeX math and mhchem chemistry, Mermaid graphs, Graphviz and PlantUML diagrams — all drawn on your device by engines built into the app. • A block of formulas tagged plot becomes a chart — curves, parametric figures and your own points, with a legend and a window you set — drawn by md itself. • Fenced code is highlighted in a quiet palette that matches the page. • Paste a table from a spreadsheet into a csv or tsv block and md draws it. • Contents lists every heading and jumps the editor and the preview to it. Private author notes — an HTML comment on its own line whose text begins with the word note — are listed in the Notes menu and never appear in the preview, the PDF or the printout. FORMAT, FIND AND TYPE • Formatting at a tap: a bar above the iPhone keyboard and a Format menu on iPad for bold, italic, code, links, headings, lists, quotes and indents, each on a hardware-keyboard shortcut as well. • Find and replace, with Replace All as a single undo. • Return continues lists, quotes and tables, and the first letter of each line and sentence is capitalized as you type. Both are switches. • On iPad, keyboard shortcuts for the layouts, Find, Print and the book. PRINT AND EXPORT • Print or export real A4 pages — or A5, US Letter, US Legal, or a paperback trim size for a book bound for print. Breaks fall between lines, and \newpage starts a fresh page wherever you decide. • Export as HTML: one self-contained file that opens anywhere, diagrams as drawings and formulas as real, selectable text. • Export as LaTeX: a .tex file where your mathematics stays mathematics, ready to paste into a paper. • Export a diagram or a plot as a standalone .svg vector, or a document as a standard EPUB 3 that carries the author, language, series and cover its front matter names. • Share the rendered PDF, share the Markdown source, or open and export TextBundle and TextPack, the Markdown-with-images container. WRITER MODE: BOOKS • A book is simply a folder: its subfolders are chapters, its Markdown files are articles, ordered by name. • Rename, reorder or delete a row and the order is written back to the file names, so it stays true in Files. • Compile the whole book into one PDF at the page size you choose, or export it as a standard EPUB 3 with a proper table of contents — math and diagrams travel with it as images. FILES YOU CAN KEEP • Your documents are ordinary text files — .md, .markdown and every other Markdown spelling, or .txt — kept where you choose, on your device or in your own iCloud Drive, in the encoding they arrived in. • md also opens PlantUML, Graphviz, TextBundle and TextPack files. Quick Look shows a TextBundle as md renders it, in Files and Mail. Built-in examples, including a small sample book, show everything the app can do. PRIVATE BY DESIGN • No accounts, no sign-in, no analytics, no tracking, no ads. • Everything is rendered on your device. The only things md fetches from the network are an image your own document points at by URL and an EPUB cover it names. The only outside code is the open-source engines for math, chemistry, diagrams and code — KaTeX, mhchem, Mermaid, Graphviz, PlantUML and highlight.js — bundled in and run on your device. The source code is public.