Jan AI is an open-source, self-hosted alternative to platforms like OpenAI’s ChatGPT, designed to run entirely offline on your desktop or mobile device (with mobile support coming soon). Here’s a detailed overview of what Jan AI does and its key features:
What Jan AI Does
Jan AI is a customizable AI assistant that allows users to download and run large language models (LLMs) locally on their computers. This approach prioritizes user privacy and control, ensuring that all data remains on the user’s device.
Key Features
Offline Capability
Jan AI operates 100% offline once the necessary models are downloaded. This means users can interact with AI models without any internet connection, enhancing privacy and security.
Model Variety
Users can download popular open-source LLMs such as Llama3, Gemma, or Mistral from the Jan Model Hub or import GGUF models from Hugging Face or local files. Additionally, Jan AI supports connections to cloud model services like OpenAI, Anthropic, and Groq.
Customization
Jan AI offers a highly customizable interface. Users can adjust parameters of the AI models, change the visual theme and appearance of the interface, and select between different chat widths for a more comfortable reading experience. The application also includes a built-in spell check feature.
Local API Server
Jan AI runs a Cortex Server in the background, providing an OpenAI-equivalent API at `https://localhost:1337`. This allows compatibility with OpenAI-compatible apps and tools like Continue.dev and Open Interpreter.
Extensions and Custom Features
Jan AI has an extensible architecture, similar to VSCode and Obsidian, allowing users to build custom features using the extensions API. Most of Jan’s features are built as extensions, making it highly adaptable to user needs.
Advanced Settings
The application includes advanced settings such as Experimental Mode, which allows access to beta features like advanced tooling, GPU acceleration using Vulkan API, and a streamlined interface for rapid AI queries. Users can also configure HTTPS Proxy settings for enhanced security and privacy.
Data Privacy
Jan AI prioritizes user privacy by storing all data locally on the user’s device. The data is stored in open file formats, and no user data is collected or sold. Users have the option to contribute anonymous basic usage data, but personal information and chat data are never collected.
Compatibility and Self-Hosting
Jan AI is compatible with Windows, Mac, and Linux operating systems. Users can download and run Jan directly or fork and build it from the GitHub repository, supporting the self-hosted movement.
Community and Development
Jan AI is fully open-source, allowing users to contribute to its development through GitHub and Discord. The community is active, and users can suggest features, make pull requests, and get involved through the Jan AI Discord channel.
In summary, Jan AI is a powerful, privacy-focused AI assistant that offers extensive customization, offline capability, and compatibility with various AI models, making it a robust alternative to cloud-based AI services.