Browser Use
RT @JangLawrenceK: We partnered with Browser-Use to release a new live web eval as a followup to the original Odysseys paper 😁
Odysseys2 serves as a task set that sources from real user requests to Browser-Use, check it out!
It was great working with @Alezander9 and @mamagnus00 - thank you to Browser-Use for the support and resources!
Browser Use @browser_useIntroducing: Odysseys2 - hardest long horizon benchmark for web agents based on real user tasks 🏗️ We collaborated with @JangLawrenceK @rsalakhu from Carnegie Mellon University > SOTA agent fully completes only 47/100 > 5 agents complete none > 8-12 real rubrics per task, 60 min on the live web Web agents are becoming better than humans at knowledge work.
030200






