OpenAI gives ChatGPT voice on-the-go feature, puts AI agent at your service 24x7

OpenAI has added agentic capabilities to ChatGPT Voice on the web and mobile app for all users. The update lets people start tasks by speaking and continue them later with text, apps and tools.

In Short

• Plus and Pro users can create documents, decks and spreadsheets by voice
• Free and Go users get voice access to existing tools and plugins
• Rich text replies now appear during conversations instead of audio alone

OpenAI is bringing ChatGPT’s agentic capabilities to the Voice experience on the web and mobile app for all users. The update allows users to simply talk to ChatGPT, tell it what they need and ask it to carry out tasks, rather than just have a conversation with the chatbot. The update builds on earlier releases such as GPT-Live, which the company described as its smartest voice model yet, and ChatGPT Voice on desktop, which launched earlier this year with access to agents such as ChatGPT Work and Codex.

OpenAI notes that with this update, the Voice feature in ChatGPT is no longer limited to answering questions or having back-and-forth conversations. Depending on the tools available, users can now ask ChatGPT to create documents, work with connected apps, browse the web, use plugins, generate images and carry out other tasks. In other words, you can speak to ChatGPT while you are on the move and have it work on something for you.

For Plus and Pro users, ChatGPT Voice in the Work tab on mobile can now create documents, presentations and spreadsheets. It can also use the cloud browser, generate images, work with connected plugins and access other tools available in ChatGPT. Users can, for example, draft emails, work with Slack messages or use ChatGPT’s finance tools, all by talking to it.

Free and Go users can also use Voice in the Chat tab with the tools, connected apps and plugins they already have access to through ChatGPT’s text experience.

OpenAI is also making it easier to switch between Voice and text. ChatGPT can now show text responses and files during a Voice conversation, so users can see the information instead of only hearing it. Users can switch between Voice and text and return to the same conversation later.

Essentially, you can start a task by talking to ChatGPT while travelling or away from your desk, and then return to the conversation later to check the response or continue working on it.

How to use ChatGPT Voice

To use the new capabilities, users can start a Voice conversation in ChatGPT on the web or mobile app and simply ask the AI to perform a task. The tools it can access will depend on the user’s plan and the apps, plugins and other capabilities connected to their account.

OpenAI suggests using Voice as a kind of “chief-of-staff” to prepare for the day while commuting, summarise priorities between meetings, pull information from email, Slack or Drive, or brainstorm ideas and turn the conversation into a document.

- Ends