Since gpt-realtime did not support live camera streams, I configured the AI to retrieve camera images via function calls.
#gptrealtime #RealtimeAPI
* this app can operate even without robot hardware, using only a smartphone.
#RobotVRM has been urgently updated to support gpt-realtime.
iOS app
Android app
******* Important *******
To use this app, you will need a separate API key from OpenAI or Anthropic.
******* Important *******
This app is based on the open-source ChatVRM by pixiv, specifically the aituber-kit for @tegnike (under the MIT license, prior to September 25, 2024).
Voice: OpenAI's Realtime API sage
149935









