Browser Use
RT @rsalakhu: Exciting collaboration with the @browser_use team on Odysseys2, the next generation of our long-horizon web navigation benchmark:
Data + Evals:
Developed jointly with Browser Use, Odysseys2 contains 100 challenging tasks grounded in real user requests and executed on the live internet.
Unlike the original Odysseys, which drew on user browsing histories, Odysseys2 reflects the distribution of real-world user requests collected by Browser Use, providing a more realistic evaluation of web agents.
Browser Use @browser_useIntroducing: Odysseys2 - hardest long horizon benchmark for web agents based on real user tasks 🏗️ We collaborated with @JangLawrenceK @rsalakhu from Carnegie Mellon University > SOTA agent fully completes only 47/100 > 5 agents complete none > 8-12 real rubrics per task, 60 min on the live web Web agents are becoming better than humans at knowledge work.
010133






