Code

History

Commits on github-token to crates/eval/src/eval.rs35+
  1. evals: Configurable judge model (#31282)Oleksiy Syvokon committed 1 year ago68a46c3
  2. eval: Don't read the model from the user settings (#31230)Marshall Bowers committed 1 year agocb52acb
  3. chore: Make terminal_view own the TerminalSlashCommand (#31070)Piotr Osiewicz committed 1 year ago77dadfe
  4. Use `anyhow` more idiomatically (#31052)Kirill Bulatov committed 1 year ago16366cf
  5. extension: Add debug_adapters to extension manifest (#30676)Piotr Osiewicz committed 1 year agoa092e2d
  6. eval: Count execution errors as failures (#30712)Oleksiy Syvokon committed 1 year ago6420df3
  7. agent: Overwrite files more cautiously (#30649)Oleksiy Syvokon committed 1 year ago255d8f7
  8. Wait to locate system-installed Node until the shell environment is loaded (#30416)Max Brunsfeld committed 1 year ago65b1396
  9. evals: Enable Python LSP (#29987)Oleksiy Syvokon committed 1 year agoac00713
  10. context_store: Refactor state management (#29910)Bennet Bo Fenner committed 1 year ago9cb5ffa
  11. agent eval: Fix `--model` arg and add `--provider` (#29883)Michael Sloan committed 1 year agobb82d9c
  12. Add eval for open_tool (#29801)Richard Feldman committed 1 year ago9efc09c
  13. context servers: Show configuration modal when extension is installed (#29309)Bennet Bo Fenner committed 1 year ago24eb039
  14. Introduce a new `StreamingEditFileTool` (#29733)Antonio Scandurra committed 1 year agof891dfb
  15. Make the default repetitions be 8, and concurrency 4 (#29576)Richard Feldman committed 1 year ago04c68dc
  16. reqwest_client: Only register proxies with valid proxy URIs (#27773)Finn Evers committed 1 year ago3a1bd38
  17. zed: Remove unnecessary clones (#29513)tidely committed 1 year agof060918
  18. eval: Add support for reading from a `.env` file (#29426)Marshall Bowers committed 1 year agoa5405fc
  19. eval: Add HTML overview for evaluation runs (#29413)Oleksiy Syvokon committed 1 year ago3389327
  20. eval: Fine-grained assertions (#29246)Agus Zubiaga committed 1 year agoce1a674
  21. Rework eval to support interpretable scores and efficient repetitions (#29197)Max Brunsfeld committed 1 year ago36d02de
  22. Add new action to run agent eval (#29158)Nathan Sobo committed 1 year ago458ffaa
  23. agent eval: Default to also running typescript examples (#29185)Michael Sloan committed 1 year ago70c51b5
  24. Start tracking tool failure rates in eval (#29122)Antonio Scandurra committed 1 year ago97ab098
  25. Simplify language model registry + only emit change events on change (#29086)Michael Sloan committed 1 year agod88b06a
  26. Systematically optimize agentic editing performance (#28961)Nathan Sobo committed 1 year agobab2856
  27. Init prompt store in agent eval (#29068)Michael Sloan committed 1 year ago327fee4
  28. agent: Add git commit ID to the eval telemetry data (#28895)Thomas Mickley-Doyle committed 1 year ago8de53bd
  29. Agent Eval: Initial support for running examples repeatedly (#28844)Michael Sloan committed 1 year ago9a9f2e7
  30. Agent Eval: bounded concurrency (#28843)Michael Sloan committed 1 year ago609895d
  31. agent: Add telemetry for eval runs (#28816)Thomas Mickley-Doyle committed 1 year ago222d4a2
  32. Add support for judge repetitions in eval (#28811)Michael Sloan committed 1 year ago102ea6a
  33. eval: Do not create run files for skipped examples (#28800)Agus Zubiaga committed 1 year ago0182e09
  34. eval: Fix stalling on tool confirmation (#28786)Agus Zubiaga committed 1 year agoff4334e
  35. eval: Improve readability with colors and alignment (#28761)Agus Zubiaga committed 1 year agoe4cf7fe