pieter/eveAI
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
232 Commits 3 Branches 24 Tags
bc1626c4ffd1b89156dde216dae7e01db2aa0826
Commit Graph

108 Commits

Author SHA1 Message Date
Josako
d6a7743f26 - Minor corrections to entitlement changes and upgrades 
- started new eveai_entitlements component (not finished)
 2024-10-08 09:12:16 +02:00
Josako
9782e31ae5 - Refined entitlements to work with MiB for both embeddings and storage 
- Improved DocumentVersion storage attributes to reflect Minio settings
- Added size to DocumentVersions to easily calculate usage
- License / LicenseTier forms and views added
 2024-10-07 14:17:44 +02:00
Josako
b700cfac64 - Improvements on audio processing to limit CPU and memory usage 
- Removed Portkey from the equation, and defined explicit monitoring using Langchain native code
- Optimization of Business Event logging
 2024-10-02 14:11:46 +02:00
Josako
883175b8f5 - Portkey log retrieval started 
- flower container added (dev and prod)
 2024-10-01 08:01:59 +02:00
Josako
ae697df4c9 Session_id was not correctly stored for chat sessions, and it was defined as an integer iso a UUID in the database 2024-09-27 11:24:43 +02:00
Josako
d9cb00fcdc Business event tracing completed for both eveai_workers tasks and eveai_chat_workers tasks 2024-09-27 10:53:42 +02:00
Josako
ee1b0f1cfa Start log tracing to log business events. Storage in both database and logging-backend. 2024-09-25 15:39:25 +02:00
Josako
a740c96630 - turned model_variables into a class with lazy loading 
- some improvements to Healthchecks
 2024-09-24 10:48:52 +02:00
Josako
67bdeac434 - Improvements and bugfixes to HealthChecks 2024-09-16 16:17:54 +02:00
Josako
6cf660e622 - Adding a Tenant Type 
- Allow filtering on Tenant Types & searching for parts of Tenant names
- Implement health checks
- Start Prometheus monitoring (needs to be finalized)
- Refine audio_processor and srt_processor to reduce duplicate code and support for larger files
- Introduce repopack to reason in LLMs about the code
 2024-09-13 15:43:40 +02:00
Josako
9e14824249 - Furter refinement of the API, adding functionality for refreshing documents and returning Token expiration time when retrieving token 
- Implementation of a first version of a Wordpress plugin
- Adding api service to nginx.conf
 2024-09-11 16:31:13 +02:00
Josako
76cb825660 - Full API application, streamlined, de-duplication of document handling code into document_utils.py 
- Added meta-data fields to DocumentVersion
- Docker container to support API
 2024-09-09 16:11:42 +02:00
Josako
341ba47d1c - Bugfixing 2024-09-05 14:31:54 +02:00
Josako
914c265afe - Improvements on document uploads (accept other files than html-files when entering a URL) 
- Introduction of API-functionality (to be continued). Deduplication of document and url uploads between views and api.
- Improvements on document processing - introduction of processor classes to streamline document inputs
- Removed pure Youtube functionality, as Youtube retrieval of documents continuously changes. But added upload of srt, mp3, ogg and mp4
 2024-09-02 12:37:44 +02:00
Josako
a158655247 - Add API Key Registration to tenant 2024-08-29 10:42:39 +02:00
Josako
122d1a18df - Allow for more complex and longer PDFs to be uploaded to Evie. First implmentation of a processor for specific file types. 
- Allow URLs to contain other information than just HTML information. It can alose refer to e.g. PDF-files.
 2024-08-27 07:05:56 +02:00
Josako
2ca006d82c Added excluded element classes to HTML parsing to allow for more complex document parsing 
Added chunking to conversion of HTML to markdown in case of large files
 2024-08-22 16:41:13 +02:00
Josako
9757830bc4 Correct functions for creating new users, confirming email, resetting password and forgot password. 2024-08-21 14:59:56 +02:00
Josako
6219d11e56 Add a DocumentVersion overview that can be sorted and can be filtered. 2024-08-20 14:18:07 +02:00
Josako
926a4e8cc2 - Add support for environment in communication with portkey 2024-08-19 12:06:10 +02:00
Josako
912cb74bb7 Merge develop into main 2024-08-19 08:03:20 +02:00
Josako
a237db339a - Improved CSRF handling 
- Wordpress plugin for Evie Chat
 2024-08-13 14:31:29 +02:00
Josako
ab38dd7540 - Improvements working with the cloud, minio, graylog and some first bugfixing 2024-08-13 09:04:19 +02:00
Josako
ab8359365d - Getting containers ready for the cloud 2024-08-06 14:56:12 +02:00
Josako
64cf8df3a9 - Improvements to enable deployment in the cloud, mainly changing file access to Minio 
- Improvements on RAG logging, and some debugging in that area
 2024-08-01 17:35:54 +02:00
Josako
88ca04136d Portkey Integration 2024-07-18 07:08:42 +02:00
Josako
908a2eaf7e - Improve annotation algorithm for Youtube (and others) 
- Patch Pytube
- improve OS deletion of files and writing of files
- Start working on Claude
- Improve template management
 2024-07-16 14:21:49 +02:00
Josako
db44fd3b66 feature/Add-URL-List 2024-07-08 15:22:35 +02:00
Josako
ea0127b4b8 Improve algorithms for HTML and PDF processing 2024-07-08 15:20:45 +02:00
Josako
cbfa6d67bf Chunk size defined at Tenant level. 2024-07-08 15:20:02 +02:00
Josako
c55fc6b7ce Added OpenAI large embedding / improve migration and upgrade handling for containers 2024-07-04 17:20:02 +02:00
Josako
8e1dac0233 Youtube added - further checking required 2024-07-04 08:11:31 +02:00
Josako
9187947f68 corrected container and other errors 2024-06-28 14:40:13 +02:00
Josako
348bdf2c15 Commit before setting up a new deployment environment 2024-06-21 13:21:54 +02:00
Josako
cc9f6c95aa Started to work on interaction views. However, need a quick check in because of a python upgrade systemwide that breaks code. 2024-06-21 09:52:06 +02:00
Josako
c5370c8026 Improvements on the chat UI, prepare for supporting multiple models, and adding feedback to interactions. 2024-06-14 15:05:46 +02:00
Josako
b77e1ab321 Variables for rag_context and fallback algorithms added to Tenant and parts of the implementation. 2024-06-13 15:23:35 +02:00
Josako
24a3747b99 Include history to improve query if required. 2024-06-13 10:35:15 +02:00
Josako
fd510c8fcd Correcting the retrieval of relevant documents 2024-06-12 16:15:48 +02:00
Josako
be311c440b Improving chat functionality significantly throughout the application. 2024-06-12 11:07:18 +02:00
Josako
27b6de8734 Removing DocumentLanguage, as both System Context and User Context are to be defined on DocumentVersion level. 
Finetuning of embedding workers.
 2024-06-06 15:26:49 +02:00
Josako
61e1372dc8 Improvements to Document Interface and correcting embedding workers 2024-06-04 14:59:38 +02:00
Josako
c660c35de4 Improvements to user views and forms + correction of schema creation for new tenants. 2024-06-03 13:24:13 +02:00
Josako
fcc0caeb09 Optimizing admin interface for user domain, completing security views 2024-06-03 09:37:59 +02:00
Josako
e5a36798bf Prepare app for working behind a proxy (nginx). 
Adapt user form
 2024-05-30 07:39:05 +02:00
Josako
ce91323dc9 Enable model variables & start working on RAG task 2024-05-25 20:17:02 +02:00
Josako
06333bf8de Connection and messages are now correct and fluently pass between client and server. 2024-05-23 12:11:23 +02:00
Josako
364da812ba API key working, CORS working, SocketIO working (but no JWT), Chat client v1, Session implemented (server side) 2024-05-22 21:32:09 +02:00
Josako
883988dbab Implement chat API key generation, and create a tenant_overview 2024-05-16 23:22:26 +02:00
Josako
8c6d9bf5ca Implement CORS-fields in views & HTML, improve list rendering & selection 2024-05-15 21:27:23 +02:00