Visualization Tool

[yueyang130]

@ChathuraT @Cheng-Xue @Vimukthini , Thanks for great work of you guys!

I recently work on evaluating visual agent physical intelligence and found the repo very useful. However, when i wanna see visualization results of the rolllout (i.e., env interaction), i can't find visualization tools to generate demo like what you show in github homepage.

Can you provide some guidance how to visualize trajectories as you do in github page?

Thanks for your time!

[yueyang130]

I have successfully generated visual trajectories by saving the agent's image observations as GIFs.

However, I discovered that the environment behaves like a bandit. The agent receives the initial state and produces an action. The environment then returns a reward, concluding the process. As a result, a trajectory only contains initial image. The following is the visualization of the initial state.

While I understand that the bandit property doesn't impact your research results on physical reasoning intelligence, my interest lies in investigating the visual physical intelligence of agents in video contexts. Therefore, I would greatly appreciate any guidance on how to create dynamic video demonstrations, as shown in the repository's README.

[XinrunXu]

Do you work out with this issue?