About AgentInstruct dataset #63
Description
I found a 'loss' field in the AgentInstruct dataset, what does it means?
eg.
[ { "from": "human", "loss": null, "value": "'''\n<html> <li id=0> <a id=1> <p> Store Locator </p> </a> </li> </html>\n'''\n\nBased on the HTML webpage above, try to complete the following task:\nTask: Locate a large store in Washington that has kids' and maternity products, also check if they have a parking lot, and see the directions of the nearest store.\nPrevious actions:\nNone\nWhat should be the next action? Please select from the following choices (If the correct action is not in the page above, please select A. 'None of the above'):\n\nA. None of the above\nB. <li id=0> <a id=1> <p> Store Locator </p> </a> </li>\nC. <a id=1> <p> Store Locator </p> </a>" }, { "from": "gpt", "loss": true, "value": "Thought: The \"TRAVEL INFO\" tab has been clicked, and the next task is to find information about Wi-Fi subscriptions. The next action should be to click on the \"Pre-paid Wi-Fi\" link.\nAnswer: D.\nAction: CLICK" }
I did not find any explanation about it in the corresponding paper and homepage.
Can you explain for me how this field is filled in the dataset?