Code

History

Commits on fix-git-https-support to crates/semantic_index/src175+
  1. Retrieve embeddings based on pending filesAntonio Scandurra committed 3 years ago6b1dc63
  2. Move retrieval of embeddings from the db into `reindex_changed_files`Antonio Scandurra committed 3 years ago7b5a41d
  3. :art:Antonio Scandurra committed 3 years agod4cff68
  4. update pragma settings for improved database performanceKCaverly committed 3 years ago8dbc0fe
  5. updated embeddings background delay to 5 minutesKCaverly committed 3 years ago54235f4
  6. optimize insert file in vector databaseKCaverly committed 3 years agoe86964e
  7. flush embeddings queue when no files are parsed for 250 millisecondsKCaverly committed 3 years ago524533c
  8. move embeddings queue to use single hashmap for all changed pathsKCaverly committed 3 years agoc4db914
  9. WIP: work towards wiring up a embeddings_for_digest hashmap that is stored for all indexed filesKCaverly committed 3 years agoafa59ab
  10. fill embeddings with database values and skip during embeddings queueKCaverly committed 3 years ago50cfb06
  11. WIPAntonio Scandurra committed 3 years ago220533f
  12. Rename `Sha1` to `DocumentDigest`Antonio Scandurra committed 3 years ago2503d54
  13. Reify `Embedding`/`Sha1` structs that can be (de)serialized from SQLAntonio Scandurra committed 3 years ago3001a46
  14. Write to and read from the database in a transactional wayAntonio Scandurra committed 3 years agoc763e72
  15. Abstract away how database transactions are executedAntonio Scandurra committed 3 years ago35440be
  16. fix bug for truncation ensuring no valid inputs are sent to openaiKCaverly committed 3 years ago7d4d6c8
  17. moved semantic index to use embeddings queue to batch and managed for atomic database writesKCaverly committed 3 years ago5abad58
  18. move queuing to embedding_queue functionality and update embedding provider to include trait items for max tokens per batch"KCaverly committed 3 years ago76ce52d
  19. move truncation to parsing step leveraging the EmbeddingProvider traitKCaverly committed 3 years ago9781047
  20. add should_truncate to embedding providersKCaverly committed 3 years ago76caea8
  21. added token count to documents during parsingKCaverly committed 3 years agoe377ada
  22. reindex files in the background after they have not been edited for 10 minutesKCaverly committed 3 years agoa7e6a65
  23. add proper handling for open ai rate limit delaysKCaverly committed 3 years ago4f8b95c
  24. Format let-else statementsMax Brunsfeld committed 3 years ago404f767
  25. cleaned up warningsKCaverly committed 3 years agoee97bc5
  26. add handling for Added file events to semantic indexKCaverly committed 3 years ago131950f
  27. update initialize project call to accomodate for test scenariosKCaverly committed 3 years agoa892a51
  28. move semantic search project intialization to a subscribe event for workspace createdKCaverly committed 3 years agoa1519e4
  29. add delete files operation for remaining files in database not included in current worktreeKCaverly committed 3 years agoe8e7b29
  30. remove worktree_file_mtimes in state as it is no longer usedKCaverly committed 3 years agoafe0e74
  31. accomodate for duplicate entries in indexing queueKCaverly committed 3 years agoaa07872
  32. update rate limiting embeddings strategy to delay lessKCaverly committed 3 years ago3f9f742
  33. fix async calls on project updated entries to ensure that all files are updating appropriatelyKCaverly committed 3 years agoe42b9e9
  34. moved semantic_index project intialization to queue and channel methodKCaverly committed 3 years ago09fd99b
  35. reorganized to stop the raceKCaverly committed 3 years ago328b7e5