Josako
99135c9b02
- Updated OpenAI client due to 'proxies' error (no longer supported).
2024-11-29 14:11:07 +01:00
Josako
1807435339
- Introduction of dynamic Retrievers & Specialists
...
- Introduction of dynamic Processors
- Introduction of caching system
- Introduction of a better template manager
- Adaptation of ModelVariables to support dynamic Processors / Retrievers / Specialists
- Start adaptation of chat client
2024-11-15 10:00:53 +01:00
Josako
aa358df28e
- Allowing for multiple types of Catalogs
...
- Introduction of retrievers
- Ensuring processing information is collected from Catalog iso Tenant
- Introduction of a generic Form class to enable dynamic fields based on a configuration
- Realisation of Retriever functionality to support dynamic fields
2024-10-25 14:11:47 +02:00
Josako
9f5f090f0c
- License Usage Calculation realised
...
- View License Usages
- Celery Beat container added
- First schedule in Celery Beat for calculating usage (hourly)
- repopack can now split for different components
- Various fixes as consequece of changing file_location / file_name ==> bucket_name / object_name
- Celery Routing / Queuing updated
2024-10-11 16:33:36 +02:00
Josako
b700cfac64
- Improvements on audio processing to limit CPU and memory usage
...
- Removed Portkey from the equation, and defined explicit monitoring using Langchain native code
- Optimization of Business Event logging
2024-10-02 14:11:46 +02:00
Josako
883175b8f5
- Portkey log retrieval started
...
- flower container added (dev and prod)
2024-10-01 08:01:59 +02:00
Josako
d9cb00fcdc
Business event tracing completed for both eveai_workers tasks and eveai_chat_workers tasks
2024-09-27 10:53:42 +02:00
Josako
a740c96630
- turned model_variables into a class with lazy loading
...
- some improvements to Healthchecks
2024-09-24 10:48:52 +02:00
Josako
6cf660e622
- Adding a Tenant Type
...
- Allow filtering on Tenant Types & searching for parts of Tenant names
- Implement health checks
- Start Prometheus monitoring (needs to be finalized)
- Refine audio_processor and srt_processor to reduce duplicate code and support for larger files
- Introduce repopack to reason in LLMs about the code
2024-09-13 15:43:40 +02:00
Josako
76cb825660
- Full API application, streamlined, de-duplication of document handling code into document_utils.py
...
- Added meta-data fields to DocumentVersion
- Docker container to support API
2024-09-09 16:11:42 +02:00
Josako
914c265afe
- Improvements on document uploads (accept other files than html-files when entering a URL)
...
- Introduction of API-functionality (to be continued). Deduplication of document and url uploads between views and api.
- Improvements on document processing - introduction of processor classes to streamline document inputs
- Removed pure Youtube functionality, as Youtube retrieval of documents continuously changes. But added upload of srt, mp3, ogg and mp4
2024-09-02 12:37:44 +02:00
Josako
122d1a18df
- Allow for more complex and longer PDFs to be uploaded to Evie. First implmentation of a processor for specific file types.
...
- Allow URLs to contain other information than just HTML information. It can alose refer to e.g. PDF-files.
2024-08-27 07:05:56 +02:00
Josako
2ca006d82c
Added excluded element classes to HTML parsing to allow for more complex document parsing
...
Added chunking to conversion of HTML to markdown in case of large files
2024-08-22 16:41:13 +02:00
Josako
ab38dd7540
- Improvements working with the cloud, minio, graylog and some first bugfixing
2024-08-13 09:04:19 +02:00
Josako
9caa423bcf
- Getting containers ready for the cloud
2024-08-07 08:37:13 +02:00
Josako
ab8359365d
- Getting containers ready for the cloud
2024-08-06 14:56:12 +02:00
Josako
64cf8df3a9
- Improvements to enable deployment in the cloud, mainly changing file access to Minio
...
- Improvements on RAG logging, and some debugging in that area
2024-08-01 17:35:54 +02:00
Josako
88ca04136d
Portkey Integration
2024-07-18 07:08:42 +02:00
Josako
908a2eaf7e
- Improve annotation algorithm for Youtube (and others)
...
- Patch Pytube
- improve OS deletion of files and writing of files
- Start working on Claude
- Improve template management
2024-07-16 14:21:49 +02:00
Josako
ea0127b4b8
Improve algorithms for HTML and PDF processing
2024-07-08 15:20:45 +02:00
Josako
8e1dac0233
Youtube added - further checking required
2024-07-04 08:11:31 +02:00
Josako
7a1b51dd0c
Docker deployment Realised
2024-06-26 12:02:14 +02:00
Josako
348bdf2c15
Commit before setting up a new deployment environment
2024-06-21 13:21:54 +02:00
Josako
fd510c8fcd
Correcting the retrieval of relevant documents
2024-06-12 16:15:48 +02:00
Josako
be311c440b
Improving chat functionality significantly throughout the application.
2024-06-12 11:07:18 +02:00
Josako
27b6de8734
Removing DocumentLanguage, as both System Context and User Context are to be defined on DocumentVersion level.
...
Finetuning of embedding workers.
2024-06-06 15:26:49 +02:00
Josako
fcc0caeb09
Optimizing admin interface for user domain, completing security views
2024-06-03 09:37:59 +02:00
Josako
ea23e8d327
Setting up the chat client functionality using SocketIO - Start
2024-05-15 14:37:21 +02:00
Josako
011bdce38d
Prepare for html document validation (added wanted tags to tenant)
2024-05-12 21:58:42 +02:00
Josako
699de951e8
Add functionality to add a URL to the system.
2024-05-10 22:44:53 +02:00
Josako
d925477e68
Setup of documents view
2024-05-05 20:21:44 +02:00
Josako
0b7f565547
gevent concurrency / asynchronous processes
...
usage of gunicorn (documented)
2024-04-30 15:50:12 +02:00
Josako
ffa60b4616
Update Document domain models to use pgvector (extension of PostgreSQL)
2024-04-30 15:09:32 +02:00
Josako
f4decbc0cd
More dynamic menu handling. Did a lot of stuff using Flask-Nav & Flask_Menu, but removed all of it becauses it became overly complex or the extensions were no longer in active development.
2024-04-28 22:15:47 +02:00
Josako
fd25c39395
Initial commit
2024-04-22 21:23:00 +02:00
