Does browsergym support som observation now?

[junleiz]

[gasse]

Yes, browsergym supports som. You can use this method to add boxes to the screenshot:

BrowserGym/browsergym/core/src/browsergym/utils/obs.py

Line 425 in 87c45ad

def overlay_som(

Example here:
https://github.com/ServiceNow/AgentLab/blob/f385533ce85b89ad9456f676ebd019221d968f85/src/agentlab/agents/dynamic_prompting.py#L819