WebGym + OpenEnv

[burtenshaw]

Thanks for sharing the project! It would be great to try out webgym with open source libraries like TRL and Unsloth. Have you considered porting the env to OpenEnv so that it's compatible with those libs?

There are also a growing number of envs on the hf hb so it should bring some attention to the project.

Full disclosure: I'm a maintainer of OpenEnv, and happy to help with the porting.

[BiEchi]

Hey @burtenshaw , we're very happy on any efforts that make WebGym more accessible. We're developing upon WebGym v1 to make it even faster, e.g. supporting mainstream RL frameworks like slime, veRL, and AReaL. These updates will be released in WebGym v2.

At the same time, we're actively seeking for potential environment and evaluation libraries to port, so we would love to support OpenEnv. However, I would like to note that the evaluation of Web environments is almost always based on VLM judges. If OpenEnv supports this in nature, we can proceed with porting.

[burtenshaw]

Interesting. We're currently working on adding LLM as a Judge in meta-pytorch/OpenEnv#388 . It would be straightforward to expand this VLM Judges and use the existing rubric API for responses, but require some work.