Skip to content

v0.5.2

Choose a tag to compare

@mayabar mayabar released this 22 Oct 07:48
· 128 commits to main since this release
1c3d559

What's Changed

  • Use custom dataset as response source by @pancak3 in #200
  • Add vllm:time_per_output_token_seconds and vllm:time_to_first_token_seconds metrics by @mayabar in #217
  • Use openai-go v3.6.1 in the tests by @irar2 in #223
  • feat(metrics): add request prompt, generation, max_tokens and success metrics by @googs1025 in #202

Full Changelog: v0.5.1...v0.5.2