Josako
ae697df4c9
Session_id was not correctly stored for chat sessions, and it was defined as an integer iso a UUID in the database
2024-09-27 11:24:43 +02:00
Josako
ee1b0f1cfa
Start log tracing to log business events. Storage in both database and logging-backend.
2024-09-25 15:39:25 +02:00
Josako
a740c96630
- turned model_variables into a class with lazy loading
...
- some improvements to Healthchecks
2024-09-24 10:48:52 +02:00
Josako
6cf660e622
- Adding a Tenant Type
...
- Allow filtering on Tenant Types & searching for parts of Tenant names
- Implement health checks
- Start Prometheus monitoring (needs to be finalized)
- Refine audio_processor and srt_processor to reduce duplicate code and support for larger files
- Introduce repopack to reason in LLMs about the code
2024-09-13 15:43:40 +02:00
Josako
76cb825660
- Full API application, streamlined, de-duplication of document handling code into document_utils.py
...
- Added meta-data fields to DocumentVersion
- Docker container to support API
2024-09-09 16:11:42 +02:00
Josako
341ba47d1c
- Bugfixing
2024-09-05 14:31:54 +02:00
Josako
914c265afe
- Improvements on document uploads (accept other files than html-files when entering a URL)
...
- Introduction of API-functionality (to be continued). Deduplication of document and url uploads between views and api.
- Improvements on document processing - introduction of processor classes to streamline document inputs
- Removed pure Youtube functionality, as Youtube retrieval of documents continuously changes. But added upload of srt, mp3, ogg and mp4
2024-09-02 12:37:44 +02:00
Josako
a158655247
- Add API Key Registration to tenant
2024-08-29 10:42:39 +02:00
Josako
2ca006d82c
Added excluded element classes to HTML parsing to allow for more complex document parsing
...
Added chunking to conversion of HTML to markdown in case of large files
2024-08-22 16:41:13 +02:00
Josako
9757830bc4
Correct functions for creating new users, confirming email, resetting password and forgot password.
2024-08-21 14:59:56 +02:00
Josako
64cf8df3a9
- Improvements to enable deployment in the cloud, mainly changing file access to Minio
...
- Improvements on RAG logging, and some debugging in that area
2024-08-01 17:35:54 +02:00
Josako
db44fd3b66
feature/Add-URL-List
2024-07-08 15:22:35 +02:00
Josako
cbfa6d67bf
Chunk size defined at Tenant level.
2024-07-08 15:20:02 +02:00
Josako
c55fc6b7ce
Added OpenAI large embedding / improve migration and upgrade handling for containers
2024-07-04 17:20:02 +02:00
Josako
348bdf2c15
Commit before setting up a new deployment environment
2024-06-21 13:21:54 +02:00
Josako
cc9f6c95aa
Started to work on interaction views. However, need a quick check in because of a python upgrade systemwide that breaks code.
2024-06-21 09:52:06 +02:00
Josako
c5370c8026
Improvements on the chat UI, prepare for supporting multiple models, and adding feedback to interactions.
2024-06-14 15:05:46 +02:00
Josako
b77e1ab321
Variables for rag_context and fallback algorithms added to Tenant and parts of the implementation.
2024-06-13 15:23:35 +02:00
Josako
24a3747b99
Include history to improve query if required.
2024-06-13 10:35:15 +02:00
Josako
fd510c8fcd
Correcting the retrieval of relevant documents
2024-06-12 16:15:48 +02:00
Josako
be311c440b
Improving chat functionality significantly throughout the application.
2024-06-12 11:07:18 +02:00
Josako
27b6de8734
Removing DocumentLanguage, as both System Context and User Context are to be defined on DocumentVersion level.
...
Finetuning of embedding workers.
2024-06-06 15:26:49 +02:00
Josako
fcc0caeb09
Optimizing admin interface for user domain, completing security views
2024-06-03 09:37:59 +02:00
Josako
ce91323dc9
Enable model variables & start working on RAG task
2024-05-25 20:17:02 +02:00
Josako
364da812ba
API key working, CORS working, SocketIO working (but no JWT), Chat client v1, Session implemented (server side)
2024-05-22 21:32:09 +02:00
Josako
883988dbab
Implement chat API key generation, and create a tenant_overview
2024-05-16 23:22:26 +02:00
Josako
8c6d9bf5ca
Implement CORS-fields in views & HTML, improve list rendering & selection
2024-05-15 21:27:23 +02:00
Josako
ea23e8d327
Setting up the chat client functionality using SocketIO - Start
2024-05-15 14:37:21 +02:00
Josako
adee283d7a
Simplify model selection for both embeddings and LLM. Editing capabilities for new tenant columns...
2024-05-13 14:58:21 +02:00
Josako
011bdce38d
Prepare for html document validation (added wanted tags to tenant)
2024-05-12 21:58:42 +02:00
Josako
667d99daa8
Full support for different Embedding models in the database. There was an error.
2024-05-08 22:40:12 +02:00
Josako
bf6d91527b
Add extra chunking information in Tenant schema
...
Add extra scripts for flask-migrate to support refactoring
2024-05-08 17:40:42 +02:00
Josako
8e5ad5f312
Refactoring part 1
...
Some changes for workers, but stopped due to refactoring
2024-05-06 21:30:07 +02:00
