OpenAI Unveils Upcoming ChatGPT Abilities: Seeing, Hearing, and Speaking in Action

By 0xGorki 09/26/23 1:29 AM

In a groundbreaking announcement on September 25, OpenAI revealed that it is set to revolutionize the way users interact with ChatGPT by introducing new voice and image recognition capabilities. This major development promises to offer users a more immersive and intuitive experience with the AI-powered conversational agent.

Voice and Image: Expanding ChatGPT’s Horizons

The introduction of voice and image recognition capabilities is poised to open up a world of possibilities for ChatGPT users. This exciting update is aimed at enhancing the user experience and enabling more versatile interactions with the AI assistant.

According to OpenAI, these new features will enable users to:

Engage in Voice Conversations: Users can now communicate with ChatGPT using their voices, allowing for dynamic and real-time exchanges. Whether you’re seeking a bedtime story for your family or settling a lively dinner debate, ChatGPT is now at your service.
Image Recognition: The AI is also getting a visual upgrade, allowing users to share images with ChatGPT to facilitate discussions and obtain information. For example, travelers can snap pictures of landmarks and engage in live conversations about their significance, or users can take pictures of their fridge and pantry to plan meals and even receive step-by-step recipe guidance.

Rollout Details

The rollout of these voice and image recognition capabilities will take place in two phases:

Voice Recognition: OpenAI will first introduce voice recognition features to Plus and Enterprise users over the next two weeks. Users on both iOS and Android platforms will have the option to opt-in to this exciting feature in their settings.
Image Recognition: Image recognition will be made available to all ChatGPT users across all platforms. This means that anyone can leverage the power of image recognition to enhance their interactions with ChatGPT.

Mitigating Risks and Ensuring Safety

OpenAI is fully aware of the potential risks associated with these new capabilities and has taken steps to address them. Here’s how:

Voice Recognition: To mitigate the risk of fraud and impersonation, OpenAI is limiting voice recognition features to its voice chat platform. It’s important to note that OpenAI is using professional voice actors for output audio, ensuring the integrity of voice interactions.
Image Recognition: OpenAI acknowledges privacy concerns related to image recognition. To address these concerns, the AI has been limited in making statements about people in images. While it’s emphasized that ChatGPT may not always be entirely accurate, it can provide general descriptions of images, which can be particularly valuable, as demonstrated in previous work with apps like Be My Eyes, designed for blind and low-vision individuals.

Moreover, OpenAI revealed that certain organizations, like Spotify, will be permitted to use voice capabilities for specific purposes, such as translating podcasts into new languages while retaining the original host’s voice.

This announcement marks a significant step forward in the evolution of AI-powered virtual assistants. OpenAI’s commitment to addressing potential concerns while delivering innovative features showcases the company’s dedication to ensuring a safe and enriching user experience.

As ChatGPT continues to evolve and expand its capabilities, it’s clear that AI-driven interactions are becoming increasingly sophisticated, intuitive, and integrated into our daily lives. The future of human-AI interactions is indeed an exciting one, and OpenAI is leading the way.

Read more:

Join us on Telegram