OfflineLLM: Private AI Chat

OfflineLLM uses a custom execution engine for LLMs, optimised specifically for Apple Silicon on iPhone, iPad, Mac and Vision Pro. Using the full power of Metal 3, OfflineLLM is able to run faster on consumer devices than apps based on llama.cpp and MLC.

Welcome to AI chatbots that can be used without the risk of compromising confidential and sensitive data.

For the first time, you can have personal GPT assistants running privately on your device without an Internet connection. No data is ever sent to the cloud. Your conversations never leave your device. Continue using your AI chatbots when in Airplane mode.

Chat directly with the LLM that powers Apple Intelligence!

Experience multi-modal vision models like never before on the iPhone. Send images to your offline AI chatbots.

Further enhance your AI chatbots using RAG (Retrieval Augmented Generation) to integrate your own documents and files into your LLMs.

Beginner mode allows novices to step into the world of LLMs and AI chatbots.

Advanced mode allows experts to configure every parameter of the LLM execution engine.

Interact with Offline LLM, anywhere and on any device. Extend the app with system Shortcuts, Automations and Widgets.

Have other tools? Use our OpenAI-compatible API to integrate with other systems.

Use state-of-the-art AI models, such as DeepSeek, Llama or Gemma to privately answer any questions you may have. Offline LLM supports any GGUF model, including:
- GPT-OSS
- DeepSeek
- Llama
- Gemma
- Phi
- Mistral
- ORCA
- MobileVLM
- StableLM
- Code Llama
- VisionLlama
- TinyLlama
- OpenHermes
- WizardLM
- RWKV

Whether you are getting ready for an important presentation, a copywriter looking for a clever turn of phrase, or a student needing to summarise a large article of text for an essay, an AI chatbot can help you. Offline LLM can be your personal AI assistant.

AI Writing Assistant:
Get personalised help from your AI chatbot. Draft anything from emails and speeches to lyrics and poems.

Grammar and Spelling Checker:
Using the fastest GPT on the App Store, quickly check and correct your grammar, spelling and function.

Professional Proofreading and Rewriting:
Use AI to proofread and rewrite your text to make it more engaging, coherent and professional.

Summarise Text:
Let your personalised AI assistant read large articles of text and summarise them neatly and concisely so that you can quickly understand large chunks of information in record time.

Personal Tutor:
Learn any concept quickly and easily. Ask your GPT tutor to explain any concept for you to learn in record time. Tackle homework and assignments with ease and get top marks.

Coding Assistant:
Your personalised AI coding assistant. Get help programming in any language, including Python, JavaScript, TypeScript, Java, Swift, Kotlin, PHP, Go, C/C++, Haskell, Perl, Ruby, Rust, C# and more. Write efficient and reliable production code in record time with the help of AI.

Learn Languages:
Learn any language with the h