A Flask-based real-time chat interface leveraging Socket.IO for real-time streaming responses from the Ollama API. This app allows users to interact with AI models, maintain chat history, and manage conversation logs. The Ollama CLI is still required to manage models.

As a Data Engineer and Architect, web development falls in my 5th wheel of expertise. 90% of the app was build in ChatGPT o1.

• Real-time AI responses using Flask-SocketIO.
• Persistent chat history with session-based storage.
• File-based chat logs stored as JSON.
• Interactive UI with chat selection, deletion, and renaming.
• Markdown and Syntax Highlighting with collapsible <think> tags.
• Secure environment variable management via .env.

• Python 3.8+
• pip (for managing dependencies)
• Ollama running locally on port 11434 (can be configured in .env)

git clone https://github.com/tiposapien/ollama_chat_app.git cd ollama_chat_app

cd <to_your_desired_folder> python -m venv .venv # activate environment source .venv/bin/activate # for linux or macos .\.venv\Scripts\activate.bat # for windows (powershell use .psi)

pip install -r requirements.txt

Save the below in a.env file and update the values:

# ----------------------------------- # Environment Variables # ----------------------------------- # Flask secret key FLASK_SECRET_KEY=your_super_secret_key_when_deployed # Ollama API base endpoint and port OLLAMA_API_BASE=http://localhost:11434/api OLLAMA_API_PORT=11434 # Debug mode (True/False) DEBUG_MODE=True

• Session details stored in <app_folder>/flask_session folder (should be created if it doesn't exist. assumes permissions)
• Chat logs stored in <app_folder>/chat_logs folder (should be created if it doesn't exist. assumes permissions)
• Ollama must be running with desired models downloaded

python app.py

The app will start at http://127.0.0.1:5000.

GET /api/models

GET /api/chat_history

GET /api/chat_logs

POST /api/load_chat Content-Type: application/json { "filename": "chat_20240301_123456.json" }

POST /api/update_chat_subject Content-Type: application/json { "filename": "chat_20240301_123456.json", "subject": "New Subject" }

POST /api/delete_chat Content-Type: application/json { "filename": "chat_20240301_123456.json" }

Ensure pytest is installed:

pip install pytest

Run tests:

pytest

ollama_chat_app/ ├── app.py # Flask app entry point ├── config.py # Configuration file ├── .env # Environment variables ├── requirements.txt # Dependencies ├── tests/ │ ├── test_api.py # Test cases for the API endpoints ├── static/ │ ├── css/styles.css # CSS Styles │ ├── js/scripts.js # JavaScript Logic ├── templates/ │ ├── index.html # Frontend UI ├── chat_logs/ # Stored chat logs ├── flask_session/ # Flask session data └── README.md # Project documentation 

This project is licensed under the MIT License.

Happy Chatting with Ollama!