Code

History

Commits on bench-script to crates/edit_prediction_cli/src/example.rs35+
  1. ep: Move scores aggegation to edit_prediction_metrics (#55609)Oleksiy Syvokon committed 6 months ago3730621
  2. ep: Add LCS-based recall (#53509)Oleksiy Syvokon committed 7 months agoc788dc5
  3. ep: Make .prompt.expected_output optional (#53505)Oleksiy Syvokon committed 7 months ago50856c9
  4. ep: Add the predicted kept characters metric [WIP] (#50566)Oleksiy Syvokon committed 7 months agob05a240
  5. ep: Change beta in deltaChrF to favor precision over recall (#52422)Oleksiy Syvokon committed 7 months ago6aaf08d
  6. ep: Store cumulative and average log-probabilities of predictions (#52177)Oleksiy Syvokon committed 7 months ago6f2e4b0
  7. Fix handling of excerpt regions in EP CLI (#49936)Max Brunsfeld committed 8 months ago5ef898d
  8. ep: Add metrics for inserted/deleted tokens (#49330)Oleksiy Syvokon committed 8 months agoae293de
  9. ep: Add option to use prompt prefill (#48964)Oleksiy Syvokon committed 9 months ago90ff8fe
  10. ep: Store cursor position in global coordinates (#48469)Oleksiy Syvokon committed 9 months ago389f665
  11. ep: Meaure isolated whitespace change ratio (#48352)Oleksiy Syvokon committed 9 months agofa37d87
  12. ep: Heuristic for detecting wrong editable region (#48343)Oleksiy Syvokon committed 9 months ago3b8d003
  13. Allow zeta2 to predict next cursor position along with edits (#47916)Max Brunsfeld committed 9 months agob642565
  14. ep_cli: Only check cursor excerpt for reversals (#48044)Ben Kunkle committed 9 months agocfd6144
  15. ep: Update teacher prompt to reduce edit reversals (#48022)Oleksiy Syvokon committed 9 months agoc3ce20b
  16. ep: Use rejected_output for DPO training + OpenAI support (#47697)Oleksiy Syvokon committed 9 months ago757ee05
  17. ep_cli: Add reversal metric (#47689)Ben Kunkle committed 9 months agob02192a
  18. Add `ep repair` command to address judge feedback (#47646)Oleksiy Syvokon committed 9 months ago71c5e14
  19. ep: Don't fail on lines with inference errors (#47406)Oleksiy Syvokon committed 9 months agoa3fd8e6
  20. ep: Add line-level exact match metric (#47383)Oleksiy Syvokon committed 9 months agod207097
  21. ep: Check whether predictions worsen brace balance (#47301)Oleksiy Syvokon committed 9 months ago099650f
  22. Add `ep parse-output` command (#47220)Oleksiy Syvokon committed 9 months ago8e48a16
  23. Fix edit history clearing bug in ep (#47017)Max Brunsfeld committed 10 months agoafaccf9
  24. ep cli: Compute editable region during format-prompt (#46929)Agus Zubiaga committed 10 months ago189c9f4
  25. Introduce zeta2 format with cursor content in original order (#46732)Max Brunsfeld committed 10 months ago20284e4
  26. Prevent stale related excerpts by avoiding storing their contents as strings (#46666)Max Brunsfeld committed 10 months agod67c8f2
  27. ep cli: Resume from output file (#46293)Agus Zubiaga committed 10 months ago42af91d
  28. ep: Add file deletion support in unified diff parsing (#46279)Oleksiy Syvokon committed 10 months ago76fed22
  29. ep cli: Include cursor file in errors (#46192)Agus Zubiaga committed 10 months agoa8bc84c
  30. ep cli: Load captured examples from Snowflake (#46102)Agus Zubiaga committed 10 months ago583a479
  31. Improve support for collecting edit prediction training and eval examples (#45914)Max Brunsfeld committed 10 months ago9a79cb8
  32. Add an action for capturing your last edit as an edit prediction example (#44841)Max Brunsfeld committed 11 months agob8e40e6
  33. Restructure concurrency in EP CLI to allow running many examples in big rust repos (#44673)Max Brunsfeld committed 11 months agob871130
  34. Add ep distill command, for generating edit prediction training examples (#44670)Max Brunsfeld committed 11 months ago1cd7563
  35. Rework edit prediction CLI (#44562)Max Brunsfeld committed 11 months ago25d7448