Required prerequisites
Questions
I am working on an issue for Camel-AI that requires integrating the benchmark for https://github.com/segev-shlomov/ST-WebAgentBench. Can the CRAB project be useful in benchmarking web agents such as ST-WebAgentBench? If so, i can perhaps integrate this benchmark here and use it to benchmark CamelAI. ST-WebAgentBench requires setting up a bunch of digital SaaS twins on docker or AWS AMI and I am looking for any ways to make the environment setup easier, cheaper to reproduce.
Required prerequisites
Questions
I am working on an issue for Camel-AI that requires integrating the benchmark for https://github.com/segev-shlomov/ST-WebAgentBench. Can the CRAB project be useful in benchmarking web agents such as ST-WebAgentBench? If so, i can perhaps integrate this benchmark here and use it to benchmark CamelAI. ST-WebAgentBench requires setting up a bunch of digital SaaS twins on docker or AWS AMI and I am looking for any ways to make the environment setup easier, cheaper to reproduce.