English
James Sun
Report

James Sun✓

@JamesZmSun

browsers & browser use for Codex & ChatGPT @openai prev: @thirdweb, @papercheckout, @Twitch, YC S16

  • San Francisco, CA
  • Joined
686 Following9K Followers1.7K Posts
  1. James Sun✓@JamesZmSun
    James Sun
    RT @thsottiaux: Day 23/ Much requested iCloud Main & Calendar plugins. Just kidding, today is a reset. Still much requested though!
    ChatGPT @ChatGPT
    Much requested, and now yours to connect: iCloud Mail and Calendar plugins are available in ChatGPT. Ask ChatGPT to find that email, catch up on your inbox, check what’s next, or update a calendar event. Phew. Available on all ChatGPT plans on web, desktop, and iOS.
    0340036
  2. ChatGPT✓@ChatGPT
    Much requested, and now yours to connect: iCloud Mail and Calendar plugins are available in ChatGPT. Ask ChatGPT to find that email, catch up on your inbox, check what’s next, or update a calendar event. Phew. Available on all ChatGPT plans on web, desktop, and iOS.
    Download
    3833815.7K1.7M
  3. James Sun✓@JamesZmSun
    James Sun
    RT @a16z: OpenAI's computer-using agents can now operate almost any app the way a person does, clicking and typing through software that never got an API, and the team building them says they're close to beating expert humans on speed. Ari Weinstein works on OpenAI's consumer computer use products, and James Sun works on the enterprise side. Both were startup founders before joining OpenAI. They join a16z's Seema Amble and Fabrizio Serafini to discuss what OpenAI's Astra model changed for computer use, the controls enterprises need for agents they can no longer watch, why computer use works as a universal API for legacy ERPs and finance systems, and why they think cheap software will push UI to get better and more personal. 0:50 What Astra changed for computer use 3:23 Consumer vs. enterprise computer use 5:43 How James runs his workday with Dots 8:06 When computer use becomes superhuman 10:01 How much autonomy to give agents 11:36 What agents mean for ad-supported sites 13:51 Computer use as the universal API 17:21 Getting enterprises to trust agents 20:22 Why the best use cases are the boring ones 25:37 Why UI isn't going away 32:38 Advice for founders building on agents 37:31 Making computer use feel coherent 40:57 Computer use's scaling moment YouTube: @AriX @JamesZmSun @OpenAI @seema_amble @fabserafini
    045098
  4. James Sun✓@JamesZmSun
    James Sun
    RT @ndmccormack: I'm excited to share that WebMCP is now enabled for MCP Apps in ChatGPT Desktop! 🚀 @OpenAI is also collaborating with to make WebMCP the default way for agents to interact with MCP Apps. Another big step toward a more seamless agentic web!
    0270119
  5. James Sun✓@JamesZmSun
    Big upgrade to the Chrome extension today! You can now control Chrome from inside by just installing the Chrome extension! You no longer have to install the Desktop app to get computer use, and the product is a lot more reliable without the dependency. Free ChatGPT users can now also bring the context of your Chrome tabs into Chat without consuming any Codex limits. The side chat now also mirrors full UI, which means you can freely toggle between Chat/Work, and access all your chats, spaces, files wherever you browse. Our goal is to bring computer use as a capability for everyone, and this is just the first step! Let us know what you think.
    ChatGPT @ChatGPT
    A few big upgrades for Chrome users today! We’re bringing the power of computer use to anyone who uses Chrome. First up: ChatGPT can now use your tabs in Chrome to make answers more useful and get things done for you. If you’re in Chat, it can look across your open tabs and gather info. If you’re in Work, ChatGPT can control your Chrome tabs to get things, like sending messages, filling out forms, or downloading files. It can even help you organize and group that pile of tabs you have open.
    331333427K
  6. ChatGPT✓@ChatGPT
    A few big upgrades for Chrome users today! We’re bringing the power of computer use to anyone who uses Chrome. First up: ChatGPT can now use your tabs in Chrome to make answers more useful and get things done for you. If you’re in Chat, it can look across your open tabs and gather info. If you’re in Work, ChatGPT can control your Chrome tabs to get things, like sending messages, filling out forms, or downloading files. It can even help you organize and group that pile of tabs you have open.
    Download
    4006439.2K1.5M
  7. James Sun✓@JamesZmSun
    As personal agents get more adoption, what do ai native websites look like? I believe that people will still use websites for “fun-to-do” experiences like creative design/shopping, while the agents will liberate people from having to use UI to do boring “have-to-do” tasks like form filling. The best web product experiences will be ones that enable users to easily bring their memory and context into a site via their agent, and collaborate with their personal agents to navigate and use the site. Last month, we launched support for WebMCP in the ChatGPT desktop browser as the first step to support this new agent native web. Today, we are taking another step forward to experiment with this direction by launching extensibility for annotation mode in the desktop browser. Annotation extensibility enables sites to suggest prompts back to the user’s agent, and attach additional metadata for agents that when used with WebMCP tools, can enable agents to do tasks faster and more efficiently on sites. The final shape for 1b users will likely look different from annotation mode, but we would love to work with developers to build on this idea, and evolve it together!
    OpenAI Developers @OpenAIDevs
    Annotations paired with WebMCP give your agents more context to act on. Check out how @kagigz uses custom annotation controls and suggested prompts to help users edit scenes and update expenses in ChatGPT’s browser.
    72192.1K
  8. OpenAI Developers✓@OpenAIDevs
    Annotations paired with WebMCP give your agents more context to act on. Check out how @kagigz uses custom annotation controls and suggested prompts to help users edit scenes and update expenses in ChatGPT’s browser.
    Download
    12453845113K
  9. James Sun✓@JamesZmSun
    How can we make the cloud computer/browser better for you in dots? We are tracking: - access issues on websites - takeover reliability on mobile - password manager not showing up in 2 step authentication flows - integration with 3rd party password managers like 1Password - latency, especially on starting browser tasks - persistence of your files/apps on the cloud computer - issues with dot controlling an seeing the local in-app browser on desktop Anything else that I’m missing and we should be tracking?
    154716216.2K
  10. James Sun✓@JamesZmSun
    James Sun
    RT @thsottiaux: Announcing dots. Dots work 24/7 for you, learn from your feedback, have their own computer, browser and can be connected to over 4k apps in our ecosystem. They’re powered by Astra our best model yet. Included in your Pro plan, without drawing down on any of your usage. You can even call a dot while it’s working. We’re getting you started with your primary dot today and soon you’ll be able to create entire teams of them.
    0793038
  11. James Sun✓@JamesZmSun
    We are so excited to launch dots today, an always on assistant that can do everything. Each dot has its own computer in the cloud so it’s able to take on anything you throw at it! We gave it: - a password manager that syncs your credentials across ChatGPT - browser use and computer use on any native Linux app - local computer use to seamlessly handoff cloud tasks <-> local, so you can work anywhere and it works everywhere Combined with the ecosystem of plugins, and the cloud coding environment, it’s truly remarkable how much it can do. I have used it from simple personal errands like keeping my badminton coach updated with my availability to complex work tasks like monitoring & actioning on product feedback from early testers that involve data analysis, testing website, slack coordination and committing code. The embodiment of the intelligence, the proactive messages, and the full power of a computer make it feel like a true personal assistant that frees you up and multiplies your ability to do ambitious work. The team worked really hard on this one, and we think you’ll really feel the magic when you use it!
    Download
    264776.7K
  12. James Sun✓@JamesZmSun
    James Sun
    RT @edbayes: we're testing a new sidebar on desktop - v curious for feedback!
    Brian Lovin @brian_lovin
    wake up babe there's a new sidebar
    0110119
  13. Brian Lovin✓@brian_lovin
    wake up babe there's a new sidebar
    Download
    64121.1K191K
  14. James Sun✓@JamesZmSun
    Today, we’re launching support for Chrome extensions in the ChatGPT desktop app! Bring the extensions you use every day to the in-app browser. You can now install, pin, and use your favorites, like 1Password, while getting things done with ChatGPT. Enterprise admins can now centrally deploy and manage extensions across their workforce so the IAB meets security requirements. Try it out and let us know what you think!
    Download
    1402082.4K425K
  15. James Sun✓@JamesZmSun
    Posts @JamesZmSun
    @liamihorne you asked and we delivered
    10228.2K
  16. James Sun✓@JamesZmSun
    With more powerful computer use capabilities in Astra, we are launching new controls & observability that makes it easy for enterprises to safely deploy CUA in their organization. Admins can now: - limit sites & apps that CUA has access to - manage individuals features like uploads/downloads/history/CDP - adjust the amount of human-in-the-loop for tasks by tuning approval settings Every screenshot, action, and approval of CUA are now streamed to OpenTelemetry so admins can easily audit and traceback each trajectory. We've been testing these controls over the last month, and have seen incredible adoption of new workflows across procurement, finance, QA, GTM, marketing, and IT in the world's largest companies. CUA is especially powerful for enterprises because many workflows are done inside legacy/in-house software that do not have any MCPs/APIs. If you are an enterprise interested in deploying computer use, send me a DM and I'll connect you with the team!
    648810.8K
  17. James Sun✓@JamesZmSun
    James Sun
    RT @thsottiaux: I am pleased to see that Ant’s new Claude Code has a version of background computer use on par with the version from Codex from last May this year. Nice work! Shipping great features first turns out to be a great way to encourage other labs to ship too. We will continue to do this until other labs pay more attention to shipping. This is good for everyone and there is a lot of room left to go! We solved computer use in practice for GPT models about four months ago. But computer use is a significantly awesome thing no matter what model you use, and it is important that the industry similarly spends more effort to train their models to be great at computer use, among other elements of model capabilities. As models become more capable and central to businesses and economies, the value of computer use only increases. We should be taking it seriously, and doing the right thing for our customers and the world.
    0173049
  18. James Sun✓@JamesZmSun
    James Sun
    RT @AriX: With Astra, ChatGPT is nearly 2x faster at computer use than before. In addition to the amazing new model, we’ve optimized the harness to make computer use run much faster. These optimizations work in existing models too, so tasks are sped up by ~60% in GPT-5.6 Sol. Try it!
    083091
  19. James Sun✓@JamesZmSun
    James Sun
    RT @OpenAI: This is GPT-6 Astra. Anything you can do on a computer, Astra can do for you. Fast.
    Download
    035.2K046
  20. James Sun✓@JamesZmSun
    James Sun
    RT @thsottiaux: The ChatGPT desktop app is now my main browser and my productivity has never been higher
    0189042
  21. James Sun✓@JamesZmSun
    James Sun
    RT @btraut: Last week, I pushed a change to the ChatGPT desktop app that makes the loading of threads faster. Not just a little faster. A LOT faster. ✅ Long threads now load over 90% faster. ✅ Decreased the memory footprint of long threads by over 90%.
    0200090
  22. James Sun✓@JamesZmSun
    Two more ships this week for the ChatGPT Desktop in-app browser! Media Tabs: Find your music or meeting without hunting through threads! All tabs with audio/video activity are now grouped in one menu in the side pane. (s/o @ngu_khoi @schwa23) Zero-state autocomplete: Jump back into your browser work faster. Just click the empty URL bar to see your most recently visited pages. (s/o @olivertepman) Let us know what you think, especially if you’re using the IAB as your daily driver. We are still working on bringing extension support safely to the IAB, thanks for your patience!
    Download
    311741129.2K
  23. James Sun✓@JamesZmSun
    WebMCP is now supported in the Cloud browser in ChatGPT work! We will bring support to Chrome extension next. S/o to @ndmccormack for pushing hard on getting this in!
    OpenAI Developers @OpenAIDevs
    The WebMCP Challenge is here. We’ve teamed up with @ChromiumDev, @CloudflareDev, @ShopifyDevs, @vercel, @render, and @Netlify for a 10-day hackathon. Up for grabs: $35,000 in cash prizes, Codex Micros, ChatGPT Pro subscriptions, and more prizes from our supporters.
    252839036.6K
  25. Show more posts