Initial commit for deployment

OLLAMA_INTEGRATION.md

@@ -0,0 +1,87 @@
+# Ollama and OpenWebUI Integration
+
+This document explains how to use the chatbot with Ollama and OpenWebUI.
+
+## Overview
+
+The chatbot has been updated to use Ollama models via OpenWebUI. The following models are now available:
+
+- **gemma3**: Google Gemma 3 model
+- **llama3.3**: Meta Llama 3 70B model
+- **llama3.1**: Meta Llama 3 8B model
+- **mistral**: Mistral AI model
+- **deepseek**: DeepSeek model
+
+## OpenWebUI
+
+OpenWebUI is running at: http://104.225.217.215:8080/
+
+### Features
+
+1. **Document Training**: OpenWebUI provides built-in RAG capabilities. When you upload a document through OpenWebUI, it automatically processes it for RAG.
+
+2. **Knowledge Database**: OpenWebUI stores documents in its knowledge database, which can be accessed during chat sessions.
+
+## Using the Integration
+
+### Configuration
+
+1. Update your `.env` file with the following settings:
+
+```
+# OpenWebUI configuration
+OPENWEBUI_URL=http://104.225.217.215:8080
+OPENWEBUI_API_KEY=your-openwebui-api-key
+
+# Ollama configuration
+OLLAMA_API_URL=http://localhost:11434
+DEFAULT_MODEL=llama3.1
+```
+
+### Document Processing
+
+To use RAG with your documents:
+
+1. Go to the OpenWebUI interface at http://104.225.217.215:8080/
+2. Navigate to the Knowledge section
+3. Upload your documents
+4. OpenWebUI will automatically process them for RAG
+
+### Chat with RAG
+
+When using the chatbot API:
+
+1. Set `use_rag=True` in your chat requests to enable RAG
+2. The system will use OpenWebUI's knowledge database to enhance responses
+
+## API Usage
+
+The API endpoints remain the same, but now they use Ollama models via OpenWebUI:
+
+```python
+# Example: Get a response with RAG
+response = chat_service.get_chat_response(
+    chat_id="your-chat-id",
+    message="Tell me about the documents I uploaded",
+    user_id="user123",
+    use_rag=True,
+    model_id="llama3.1"  # Use one of the Ollama models
+)
+```
+
+## Troubleshooting
+
+If you encounter issues:
+
+1. Make sure OpenWebUI is accessible at http://104.225.217.215:8080/
+2. Check that you have the correct API key if authentication is enabled
+3. Verify that the documents are properly uploaded to OpenWebUI's knowledge database
+
+## Direct Usage
+
+For direct usage without the API, you can:
+
+1. Go to http://104.225.217.215:8080/
+2. Select the model you want to use
+3. Upload documents in the Knowledge section
+4. Chat with the model and it will use the knowledge database automatically