v0.1.0-rc.1

What's Changed

• Bump anthropic from 0.28.1 to 0.30.0 by @dependabot in #127
• Add a test case for a single dimension evaluation by @bugsz in #123
• Change the input type of the ReachGoalLLMEvaluator by @bugsz in #129
• Support Azure API for agent and env models; Fix updates on langchain V0.2 by @ruiyiw in #132
• Improve the benchmark by evaluating multiple models and display the results by @bugsz in #126
• Bump litellm from 1.23.16 to 1.40.13 by @dependabot in #125
• background as variable by @XuhuiZhou in #137
• [Automated] Merge release into main by @ProKil in #146
• Bump anthropic from 0.30.1 to 0.31.2 by @dependabot in #139
• finished custom url call by @Jasonqi146 in #142
• Autofix precommit for PRs by @ProKil in #143
• Enabled custom API key for custom OpenAI API by @Jasonqi146 in #154
• Bump types-setuptools from 70.3.0.20240710 to 71.1.0.20240724 by @dependabot in #153
• Bump pytest from 8.2.2 to 8.3.2 by @dependabot in #157
• fix call back handler by @XuhuiZhou in #156
• Fix CI on main by @ProKil in #167
• Bump pydantic from 1.10.12 to 1.10.17 by @dependabot in #168
• Improve the docs and sync with dev by @XuhuiZhou in #166
• Bump mypy from 1.10.1 to 1.11.1 by @dependabot in #162
• Remove all_pks from Sampler.sample by @ProKil in #160
• Bump types-setuptools from 71.1.0.20240806 to 72.2.0.20240821 by @dependabot in #173
• structured output by @XuhuiZhou in #175
• Improvements on benchmark display and usage by @bugsz in #135

New Contributors

• @Jasonqi146 made their first contribution in #142

Full Changelog: v0.0.11...v0.1.0-rc.1

v0.0.11

What's Changed

Depedencies

• Bump pettingzoo from 1.24.0 to 1.24.3 by @dependabot in #112
• Bump google-generativeai from 0.6.0 to 0.7.0 by @dependabot in #111
• Bump lxml from 4.9.4 to 5.2.2 by @dependabot in #118
• Bump anthropic from 0.26.1 to 0.28.1 by @dependabot in #117
• Bump fastapi from 0.109.2 to 0.110.3 by @dependabot in #121

Code Coverage

• support codecov by @lwaekfjlk in #100

Docs

• Add platform selection button in redis installation section by @ProKil in #114

Feature Changes

• Langchain V0.2 and Sync API deprecated by @ProKil in #116
• Setup everything for sotopia in one script by @ProKil in #122

Full Changelog: v0.0.10...v0.0.11

v0.0.10

What's Changed

• Sotopia Benchmark CLI API by @XuhuiZhou @ProKil in #69
• Bump google-generativeai from 0.5.4 to 0.6.0 by @dependabot in #108
• Sync main branch with release by @ProKil in #106
• Bump groq from 0.4.2 to 0.9.0 by @dependabot in #105
• Bump langchain-openai from 0.0.5 to 0.0.6 by @dependabot in #103
• Remove pandas dependency by @ProKil in #109

New Contributors

• @dependabot made their first contribution in #108

Full Changelog: v0.0.9...v0.0.10

v0.0.9

What's Changed

• Tutorial notebooks that can be directly opened in colab by @ProKil in #90
• simutaneous -> simultaneous; allow CI to be run from PR by @ProKil @Armxyz1 in #97
• support concurrency control for workflow by @lwaekfjlk in #99
• support dependabot for auto package bump by @lwaekfjlk in #98

Full Changelog: v0.0.8...v0.0.9

v0.0.8

What's Changed

• Pin LiteLLM version by @ProKil in #87
• bump to 8.0.0 by @ProKil in #88

Full Changelog: v0.0.7...v0.0.8

v0.0.7

What's Changed

• bumped langchain and openai version by @ProKil in #25
• fix empty background issue by @bugsz in #27
• support human evaluation task release based on Otree by @lwaekfjlk in #31
• Feature/litellm by @clementou in #32
• add csv& json by @XuhuiZhou in #30
• add agreement calculation for human eval by @lwaekfjlk in #35
• Update sampler in server configuration by @ProKil in #33
• fix expired link in README by @lwaekfjlk in #44
• add more instruction for the redis deployment by @lwaekfjlk in #45
• Use Ruff as the formatter by @ProKil in #41
• support full serialization of database by @lwaekfjlk in #46
• Fixed litellm context length by @ProKil in #53
• Update README.md with instructions for running code and accessing data by @XuhuiZhou in #42
• add more badges by @lwaekfjlk in #66
• Add a link to a google colab tutorial by @ProKil in #67
• update pyproject.toml by @lwaekfjlk in #50
• Feature/benchmark_evaluator by @XuhuiZhou in #68
• support more notebooks for redis guideline by @lwaekfjlk in #63
• Add Colab Tutorial to Readme by @ProKil in #73
• Adding a doc site using Nextra by @ProKil in #78
• Update dependency list and move optional ones to extra dependencies by @ProKil in #80

New Contributors

• @lwaekfjlk made their first contribution in #31
• @clementou made their first contribution in #32

Full Changelog: agent_vs_storyteller_v1...v0.0.7

v0.0.1-alpha

The version for running simulation of agent vs story-teller