Change Log
This release introduces 2 new breaking changes:
- More data is included within the Qdrant Database ( See the migration script to add more data here)
- We are migrating to paradedb to use the pgbm25 extension for full text search. MIGRATIONS WILL AUTO RUN, if you update and did not mean to you should be able to revert
Server
- Text search in qdrant (faster search) ~0.6 second query
- Hybrid search
- Page count no longer is 100 by default
- Time stamps/Date filters
Chat
Search
- UI fixes
Relevant commits
feature: text search in qdrant
feature: hybrid search
feature: use rrf rather than simple weighted average
feature: normalize scores
cleanup: Remove key-cloak service
feature: rerank with cross encoder
feature: make search relevance better
feature: truncate result set to 10
feature: frontend support for hybrid search
feature: switch between cross_encoder and rrf
feature: UI for hybrid weights, bugfix: 0/1 vals for semantic/full-text weights
feature: rrf to weighted average
cleanup: restore page sizes to 10
cleanup: make weight initialize correctly
cleanup: proper page count for hybrid, consistent full-text
bugfix: use paradedb
cleanup: update README and error message for full-text
feature: create indexes and add to qdrant metadata on card creation
feature: filtering with qdrant
feature: timestamp support + qdrant sync script
feature: migration script
bugfix: fix popover close on click
touchup: final changes to resolve PR comments
lint: remove unused components from astro file
cleanup: update docker-compose to remove keycloak
bugfix: remove pool1 from call to search_card_query
bugfix: proper python reqs for onnx
bugfix: make search type sticky
bugfix: sticky search query param
bugfix: set weight and hybrid mode properly for search
bugfix: file upload timestamp should only set when present
bugfix: set time_stamp only when present for createnewdocchunk form
bugfix: set page count properly for semantic and full-text search
feature: add tag set to document chunk creation form
bugfix: incorrect import in card_handler
cleanup: only show pagination controller on results when there are more than 0 results