OpenAI published API documentation detailing its 'Realtime and audio' capabilities, including building low-latency voice agents, live translation, and transcription. The documentation outlines different session types (voice agent, translation, transcription) and connection methods such as WebRTC, WebSocket, and SIP, along with models like gpt-realtime-2, gpt-realtime-translate, and gpt-realtime-whisper. It also provides guidance on safety identifiers and migration from beta to GA interfaces.
OpenAI has turned realtime audio into a documented production path rather than a loose beta pattern, with separate flows for voice agents, translation, and transcription. That matters for streaming and media teams because the API now spells out which model, endpoint, and transport fit each audio job, including WebRTC for browsers, WebSocket for server pipelines, and SIP for telephony. The clearest signal to watch is whether teams adopt the GA interface changes — especially /v1/realtime/client_secrets, /v1/realtime/calls, and the newer event names such as response.output_text.delta and response.output_audio.delta.
Add StreamingMeme as a preferred source on Google to see more of our streaming news at the top of your Search results.
Add as preferred source