Josako
6cf660e622
- Adding a Tenant Type
...
- Allow filtering on Tenant Types & searching for parts of Tenant names
- Implement health checks
- Start Prometheus monitoring (needs to be finalized)
- Refine audio_processor and srt_processor to reduce duplicate code and support for larger files
- Introduce repopack to reason in LLMs about the code
2024-09-13 15:43:40 +02:00
Josako
76cb825660
- Full API application, streamlined, de-duplication of document handling code into document_utils.py
...
- Added meta-data fields to DocumentVersion
- Docker container to support API
2024-09-09 16:11:42 +02:00
Josako
341ba47d1c
- Bugfixing
2024-09-05 14:31:54 +02:00
Josako
ae7bf3dbae
- Correct default language when adding Documents and URLs
2024-09-02 14:04:22 +02:00
Josako
914c265afe
- Improvements on document uploads (accept other files than html-files when entering a URL)
...
- Introduction of API-functionality (to be continued). Deduplication of document and url uploads between views and api.
- Improvements on document processing - introduction of processor classes to streamline document inputs
- Removed pure Youtube functionality, as Youtube retrieval of documents continuously changes. But added upload of srt, mp3, ogg and mp4
2024-09-02 12:37:44 +02:00
Josako
122d1a18df
- Allow for more complex and longer PDFs to be uploaded to Evie. First implmentation of a processor for specific file types.
...
- Allow URLs to contain other information than just HTML information. It can alose refer to e.g. PDF-files.
2024-08-27 07:05:56 +02:00
Josako
6219d11e56
Add a DocumentVersion overview that can be sorted and can be filtered.
2024-08-20 14:18:07 +02:00
Josako
64cf8df3a9
- Improvements to enable deployment in the cloud, mainly changing file access to Minio
...
- Improvements on RAG logging, and some debugging in that area
2024-08-01 17:35:54 +02:00
Josako
8f08d6e1ae
Allow for a list of URLs to be entered into the system.
2024-07-08 15:17:10 +02:00
Josako
8e1dac0233
Youtube added - further checking required
2024-07-04 08:11:31 +02:00
Josako
9187947f68
corrected container and other errors
2024-06-28 14:40:13 +02:00
Josako
be311c440b
Improving chat functionality significantly throughout the application.
2024-06-12 11:07:18 +02:00
Josako
27b6de8734
Removing DocumentLanguage, as both System Context and User Context are to be defined on DocumentVersion level.
...
Finetuning of embedding workers.
2024-06-06 15:26:49 +02:00
Josako
61e1372dc8
Improvements to Document Interface and correcting embedding workers
2024-06-04 14:59:38 +02:00
Josako
e5a36798bf
Prepare app for working behind a proxy (nginx).
...
Adapt user form
2024-05-30 07:39:05 +02:00
Josako
6f13d72261
Prullen in de marge
2024-05-14 08:29:13 +02:00
Josako
6c2e99f467
Realise processing of HTML and improve both HTML & PDF processing giving new tenant information.
2024-05-13 17:18:38 +02:00
Josako
011bdce38d
Prepare for html document validation (added wanted tags to tenant)
2024-05-12 21:58:42 +02:00
Josako
699de951e8
Add functionality to add a URL to the system.
2024-05-10 22:44:53 +02:00
Josako
bf6d91527b
Add extra chunking information in Tenant schema
...
Add extra scripts for flask-migrate to support refactoring
2024-05-08 17:40:42 +02:00
Josako
cd5afa0408
Refactoring finished :-)
...
eveai_workers now working (with errors ;-) )
Remote debugging now available
2024-05-07 22:51:48 +02:00
Josako
131c609e68
Refactoring part 2
...
Necessary changes to ensure correct working of eveai_app
2024-05-06 23:07:45 +02:00
Josako
8e5ad5f312
Refactoring part 1
...
Some changes for workers, but stopped due to refactoring
2024-05-06 21:30:07 +02:00
Josako
d925477e68
Setup of documents view
2024-05-05 20:21:44 +02:00
Josako
659588deab
Changes Documents - llm and languagefields on tenant, processing on documents
...
first version of Adding Documents (excl. embeddings)
2024-05-02 00:12:27 +02:00
Josako
9f350b5ea0
realise document upload - Part 1
2024-04-30 22:47:44 +02:00
Josako
ffa60b4616
Update Document domain models to use pgvector (extension of PostgreSQL)
2024-04-30 15:09:32 +02:00
