Commit Graph

58 Commits

Author SHA1 Message Date
Josako
2ca006d82c Added excluded element classes to HTML parsing to allow for more complex document parsing
Added chunking to conversion of HTML to markdown in case of large files
2024-08-22 16:41:13 +02:00
Josako
9757830bc4 Correct functions for creating new users, confirming email, resetting password and forgot password. 2024-08-21 14:59:56 +02:00
Josako
6219d11e56 Add a DocumentVersion overview that can be sorted and can be filtered. 2024-08-20 14:18:07 +02:00
Josako
a237db339a - Improved CSRF handling
- Wordpress plugin for Evie Chat
2024-08-13 14:31:29 +02:00
Josako
ab38dd7540 - Improvements working with the cloud, minio, graylog and some first bugfixing 2024-08-13 09:04:19 +02:00
Josako
ab8359365d - Getting containers ready for the cloud 2024-08-06 14:56:12 +02:00
Josako
64cf8df3a9 - Improvements to enable deployment in the cloud, mainly changing file access to Minio
- Improvements on RAG logging, and some debugging in that area
2024-08-01 17:35:54 +02:00
Josako
db44fd3b66 feature/Add-URL-List 2024-07-08 15:22:35 +02:00
Josako
cbfa6d67bf Chunk size defined at Tenant level. 2024-07-08 15:20:02 +02:00
Josako
f082e7a242 Show tenant selection after login of Super User 2024-07-08 15:18:11 +02:00
Josako
8f08d6e1ae Allow for a list of URLs to be entered into the system. 2024-07-08 15:17:10 +02:00
Josako
c55fc6b7ce Added OpenAI large embedding / improve migration and upgrade handling for containers 2024-07-04 17:20:02 +02:00
Josako
8e1dac0233 Youtube added - further checking required 2024-07-04 08:11:31 +02:00
Josako
9187947f68 corrected container and other errors 2024-06-28 14:40:13 +02:00
Josako
7a1b51dd0c Docker deployment Realised 2024-06-26 12:02:14 +02:00
Josako
348bdf2c15 Commit before setting up a new deployment environment 2024-06-21 13:21:54 +02:00
Josako
cc9f6c95aa Started to work on interaction views. However, need a quick check in because of a python upgrade systemwide that breaks code. 2024-06-21 09:52:06 +02:00
Josako
b77e1ab321 Variables for rag_context and fallback algorithms added to Tenant and parts of the implementation. 2024-06-13 15:23:35 +02:00
Josako
fd510c8fcd Correcting the retrieval of relevant documents 2024-06-12 16:15:48 +02:00
Josako
be311c440b Improving chat functionality significantly throughout the application. 2024-06-12 11:07:18 +02:00
Josako
27b6de8734 Removing DocumentLanguage, as both System Context and User Context are to be defined on DocumentVersion level.
Finetuning of embedding workers.
2024-06-06 15:26:49 +02:00
Josako
1a25313673 Cosmetics to Tenant Domain Registration 2024-06-04 15:10:51 +02:00
Josako
61e1372dc8 Improvements to Document Interface and correcting embedding workers 2024-06-04 14:59:38 +02:00
Josako
c660c35de4 Improvements to user views and forms + correction of schema creation for new tenants. 2024-06-03 13:24:13 +02:00
Josako
fcc0caeb09 Optimizing admin interface for user domain, completing security views 2024-06-03 09:37:59 +02:00
Josako
e5a36798bf Prepare app for working behind a proxy (nginx).
Adapt user form
2024-05-30 07:39:05 +02:00
Josako
ce91323dc9 Enable model variables & start working on RAG task 2024-05-25 20:17:02 +02:00
Josako
883988dbab Implement chat API key generation, and create a tenant_overview 2024-05-16 23:22:26 +02:00
Josako
8c6d9bf5ca Implement CORS-fields in views & HTML, improve list rendering & selection 2024-05-15 21:27:23 +02:00
Josako
6f13d72261 Prullen in de marge 2024-05-14 08:29:13 +02:00
Josako
6c2e99f467 Realise processing of HTML and improve both HTML & PDF processing giving new tenant information. 2024-05-13 17:18:38 +02:00
Josako
adee283d7a Simplify model selection for both embeddings and LLM. Editing capabilities for new tenant columns... 2024-05-13 14:58:21 +02:00
Josako
011bdce38d Prepare for html document validation (added wanted tags to tenant) 2024-05-12 21:58:42 +02:00
Josako
699de951e8 Add functionality to add a URL to the system. 2024-05-10 22:44:53 +02:00
Josako
bf6d91527b Add extra chunking information in Tenant schema
Add extra scripts for flask-migrate to support refactoring
2024-05-08 17:40:42 +02:00
Josako
cd5afa0408 Refactoring finished :-)
eveai_workers now working (with errors ;-) )
Remote debugging now available
2024-05-07 22:51:48 +02:00
Josako
131c609e68 Refactoring part 2
Necessary changes to ensure correct working of eveai_app
2024-05-06 23:07:45 +02:00
Josako
8e5ad5f312 Refactoring part 1
Some changes for workers, but stopped due to refactoring
2024-05-06 21:30:07 +02:00
Josako
d925477e68 Setup of documents view 2024-05-05 20:21:44 +02:00
Josako
31250443c2 Add the prefered embedding model to the add_document interface 2024-05-02 10:19:15 +02:00
Josako
659588deab Changes Documents - llm and languagefields on tenant, processing on documents
first version of Adding Documents (excl. embeddings)
2024-05-02 00:12:27 +02:00
Josako
9f350b5ea0 realise document upload - Part 1 2024-04-30 22:47:44 +02:00
Josako
ffa60b4616 Update Document domain models to use pgvector (extension of PostgreSQL) 2024-04-30 15:09:32 +02:00
Josako
8e069cc653 Correct tenant in session using to_dict 2024-04-30 15:08:04 +02:00
Josako
9faf5a9fc0 Add index file - / route 2024-04-29 15:18:22 +02:00
Josako
1956b8a29b Added tenant information to the session... 2024-04-29 13:18:34 +02:00
Josako
17766aedbd finish implementing Flask_Security_Too and finished dynamic navbar creation. 2024-04-29 12:58:48 +02:00
Josako
f4decbc0cd More dynamic menu handling. Did a lot of stuff using Flask-Nav & Flask_Menu, but removed all of it becauses it became overly complex or the extensions were no longer in active development. 2024-04-28 22:15:47 +02:00
Josako
f782519c40 Added role definition handling to user 2024-04-28 15:54:12 +02:00
Josako
e8f97b7317 finetune Form presentation
Ease the development of future forms
Adapt tenant and user forms
2024-04-26 18:17:42 +02:00