Philipp Schmid✓

@_philschmid

Agents & Gemini API, MTS @GoogleDeepMind | prev: Tech Lead at @huggingface, AWS ML Hero 🤗 Sharing my own views and AI News 🧑🏻‍💻 https://t.co/7IosdlO6RA

1.2K Following126K Followers6.5K Posts
  1. Philipp Schmid✓@_philschmid
    The Interactions API is now generally available. 🎉 The Interactions API is the simplest way to build with Gemini for humans and agents. - One API for Gemini models and agents. - Antigravity Agent with a isolated remote Linux sandbox. - Image gen with Nano Banana; music with Lyria 3, soon video with Omni. - `background=True` for async, long-running interactions. - Multimodal Tool Use & Combination. - Dedicated skills for coding agent. Building something new inside Google isn't easy, but it's possible. We spent almost a year on this because we think developers and agents deserve an API that is intuitive, familiar and easy to learn and use and evolves with improving capabilities and new behaviors. Give it a try. Feature requests, bugs, complaints all to me. 👇🏻
    Download
    282427647.3K
  2. Philipp Schmid✓@_philschmid
    Gemini 4 Carbon, the next iteration of our frontier model is coming. Building on Argon with stronger coding and cybersecurity. Same $2 in / $10 out*. Scores 59 on AA v5. In testing with trusted partners. Developer access as soon as possible. Looking forward to sharing this with you!
    Download
    29153399.2K
  3. Philipp Schmid✓@_philschmid
    Genie 4 is here and it comes native audio, characters that move and talk, sharper physics, and live prompt edits. Genie is a real-time multimodal world model that renders playable environments frame by frame in response to your live keyboard controls and text prompts. Sign up for the waitlist (Google AI Ultra goes first): More Examples at:
    Download
    102705.2K
  4. Philipp Schmid✓@_philschmid
    We launched the Gemini API CLI. A CLI for calling the Gemini API. Give it to the agent you already use (Claude Code, Codex, Antigravity, Cursor, OpenClaw, Hermes...). It's NOT a new coding agent you can use it too: 1. Generate images, video, speech, music. 2. Analyze PDFs, images, audio, video, YouTube URLs, 3. Transcribe recordings to md / json / srt, 4. Run Deep Research in the background. Stateless. No memory, no chat mode. Your agent owns the context and the plan, gemini-api does the API call. Build for Agents, it's self-describing. `--help`, `--dry-run`... Start here:
    Download
    2121621.8K218K
  5. Philipp Schmid✓@_philschmid
    Hey, no AI posts today. Tough day to be an engineer. If you are using Railway, LiteLLM, PHP, GitLab, Node (brotli) please check your setup. Below some helpful links and a prompt for your agent. Check even if you think you aren't impacted. Don't give up. We're in this together. Help each other out.
    354140527.6K
  6. Philipp Schmid✓@_philschmid
    Posts @_philschmid
    Advisories & checkers: - Live CVE feed: - PHP2Shell checker & fix: - Node.js security releases: (Brotli guide: - LiteLLM 1.107.0 advisory: - Railway disclosure: - GitLab 19.5.1 patch:
    312455.1K
  7. Philipp Schmid✓@_philschmid
    Posts @_philschmid
    ``` Run a read-only check on this repo, its containers, and my local environment for the Oct 21-22, 2026 security disclosures (ask before editing files): 1. Supply-chain & secrets (scanners miss these): - LiteLLM 1.107.0: check all Python lockfiles, Docker tags (`latest`/`1.107.0`), and local `site-packages` + `/tmp` for `cook.pth`, ` `litellm_init.pth`, `/tmp/.pc_once_*`, or `/tmp/remote_code_loader.lock`. - Railway: check for `railway.*` configs or `RAILWAY_*` CI vars and list every secret/API key/DB URL referenced so I can rotate them at the source provider. 2. Runtimes & infra: check local versions, base images, and IaC for PHP (<8.5.12 / 8.4.27 / 8.3.36 / 8.2.35), Node/Bun Brotli decoding, self-hosted GitLab (<19.5.1, CVE-2026-110264), and eMudhra CA stores (`uv <0.11.7`, `certifi <2026.10.20`). 3. Direct & transitive deps: run available scanners (`osv-scanner`, `uvx pip-audit`, `npm/pnpm/bun audit`, `govulncheck ./...`) and check lockfiles against Return a compact table: Status (`ROTATE KEYS` / `PATCH` / `SAFE`) | Component | Location | Exact Fix Command. ```
    46394.1K
  8. Philipp Schmid✓@_philschmid
    The easiest way to try Gemini 4 Argon in an agentic environment is Gemini Managed Agents. A single API call gets you - Python, Node.js, Git, and Bash. - Full network access and control. - Dedicate Credentials API. - Filesystem to persist work. - Background Support.
    Download
    184907.2K
  9. Philipp Schmid✓@_philschmid
    Can Agents improve their own harness on unseen tasks? The @GoogleResearch team released Harness², a framework that allows improve an harness around a frozen model. How it works: 1️⃣ Agent runs the base harness on each task to record a baseline trajectory 2️⃣ Editor agent inspects the trajectory, drafts 2 candidate edits (SI, Skills, hooks,….), and runs both. 3️⃣ Composer agent diffs the new trajectory against the baseline, merges edits that fixed failures (within a cap), and runs the final harness. 4️⃣ Reflector agent logs verified lessons into file and saves the winning components to a library for future tasks to pull on demand. Results: - 💡 Gemini 3.5 Flash +8.4 on WorkBuddy-Bench and +7.5 on JobBench. - 🛠️ Skills and scripts drive ~50% of edits; dropping skills costs 5.3 pts. - 📚 Gemini 3.5 Flash improves on all 3 benchmarks when editing its own harness. Paper: Code:
    Download
    543432717.6K
  10. Philipp Schmid✓@_philschmid
    Gemini 4 Argon in now available for Pro subscribers.
    Philipp Schmid @_philschmid
    what's your early feedback on Gemini 4 Argon? where should we improve? we take your input seriously.
    12512447175K
  11. Philipp Schmid✓@_philschmid
    what's your early feedback on Gemini 4 Argon? where should we improve? we take your input seriously.
    1.2K401.4K265K
  12. Philipp Schmid✓@_philschmid
    Posts @_philschmid
    Full details:
    0171.5K
  13. Philipp Schmid✓@_philschmid
    Posts @_philschmid
    Gemini 4 Argon in now available for Pro subscribers.
    8172.4K
  14. Philipp Schmid✓@_philschmid
    The new Gemma docs! 🥁🥁🥁 From capabilities, to fine-tuning guides, inference optimizations and educational content on how the models work. All at central place!
    Download
    1081398.4K
  15. Philipp Schmid✓@_philschmid
    Thank you for all that feedback. Will go through all of it and see how we can help improve the experiences.
    Philipp Schmid @_philschmid
    what's your early feedback on Gemini 4 Argon? where should we improve? we take your input seriously.
    5001319.4K
  16. Philipp Schmid✓@_philschmid
    Gave Gemini 4 Argon a photo of the Manhattan skyline asked it to recreate it as oil painting. It wrote a multi-pass canvas renderer that starts with broad background strokes, blocks in the buildings and river, and finishes with fine specular highlights on the water.
    Download
    131214919.8K
  17. Philipp Schmid✓@_philschmid
    Gemini 4 Argon is now live in the Gemini API and @GoogleAIStudio 🎉 What it has done at Google so far: - A months-long Chrome refactor at ~4x the usual pace - 35%+ more agentic code submissions - Improved session creation in ADK by 40% - 2.9x the throughput increases in SGLang for Gemma 4 With Gemini 4 you should spend most of your time writing a clear goal and a way to check the result. Through your hardest challenge and convince yourself:
    Download
    251318210.3K
  18. Philipp Schmid✓@_philschmid
    Posts @_philschmid
    Also rolling out in @Antigravity (Google AI Ultra), and the @GeminiApp and AI Mode in Search (Google AI Pro and Ultra). Read more:
    30131.5K
  19. Philipp Schmid✓@_philschmid
    👀
    Logan Kilpatrick @OfficialLoganK
    Gemini
    1512167.6K
  20. Philipp Schmid✓@_philschmid
    Will be at @aiDotEngineer in NYC this week! 🔥 - Building a autonomous coworker | 10/14 2:55pm - @GoogleDeepMind Booth | most of the time Come by if you build agents, evals or have feedback about Gemini.
    Download
    42264.7K
  21. Philipp Schmid✓@_philschmid
    SynthID Detector ( is now publicly available, supporting the Nano Banana 2.1, @OpenAI, @nvidia, Kakao, and soon @Apple. 🌐 Verify if an image, video, or audio file was generated: 1️⃣ Upload or paste your file at 2️⃣ Scans for watermarks from Google or our partners (files are deleted right after)
    Download
    124424.8K
  22. Philipp Schmid✓@_philschmid
    Add: &gt; can communicate technical concepts to none ai native engineers. &gt; pushes to keeps things simple and says no to features/behaviors
    adel 🌟 @adelwu_
    literal hardest role to hire for rn and every ai startup wants someone &gt; chronically online (knows trends) &gt; has taste &amp; can create (new media) &gt; understands ai &amp; technical &gt; can execute with quality (operator) such a small niche of folks who can do this
    81284.6K
  23. Philipp Schmid✓@_philschmid
    &gt; A completely filled up glass of wine and a clock at 3:30pm - Nano Banana 2.1
    Download
    1632329.4K
  24. adel 🌟✓@adelwu_
    literal hardest role to hire for rn and every ai startup wants someone &gt; chronically online (knows trends) &gt; has taste &amp; can create (new media) &gt; understands ai &amp; technical &gt; can execute with quality (operator) such a small niche of folks who can do this
    6662375.8K1.5M