Free LLMs - Local AI Interface
A modern, production-ready web application that provides a beautiful interface for interacting with local Large Language Models through Ollama.
The Problem
Cloud-based AI services raise concerns about data privacy, require internet connectivity, and often come with API costs. While Ollama provides local LLM capabilities, it lacks a user-friendly interface for non-technical users and doesn't offer advanced features like chat management, model comparison, or hyperparameter tuning.
The Solution
Free LLMs bridges this gap with a WhatsApp-inspired interface that makes local AI accessible to everyone. It provides complete control over your data with zero cloud dependencies, supports multiple models with customizable hyperparameters, and includes advanced features like DeepSeek reasoning visualization, real-time streaming responses, and comprehensive chat management—all running entirely on your local machine.
Frontend
AI & Backend
Designed a familiar 1/3-2/3 split layout with chat list and conversation view, complete with unread indicators, real-time updates, and a modern dark theme that makes AI interaction feel natural and accessible.
Implemented real-time visualization of AI reasoning processes in collapsible sections, allowing users to see how models think through problems—perfect for learning, debugging, and building trust in AI decisions.
Built an intelligent model downloader with variant selection, real-time progress tracking, and hardware requirement indicators. Users can browse, download, and manage models from Ollama's library with a single click.
Architected a zero-cloud-dependency system with all conversations stored locally in JSON format. Includes chat persistence, export to Markdown, and search functionality—ensuring complete data ownership and privacy.
Developed per-chat hyperparameter customization (temperature, top-p, top-k, max tokens) and system message configuration, giving users precise control over AI behavior for different use cases.
WhatsApp-Inspired Chat Interface
DeepSeek Reasoning Visualization
Advanced Model Management