Future Synthetic Voice Safety: Expanding on How Voice Engine Works and Our Safety Research


Profile Icon
reiserx
2 min read
Future Synthetic Voice Safety: Expanding on How Voice Engine Works and Our Safety Research

Introduction

We strive to advance artificial intelligence responsibly and transparently. In this piece, we delve into the workings of our Voice Engine, a sophisticated text-to-speech (TTS) model capable of generating human-like audio from text. We also discuss our ongoing safety research to ensure the responsible deployment of this technology.

How Voice Engine Works

Voice Engine is powered by a cutting-edge TTS model that can generate audio from text and a brief 15-second sample of a speaker's voice. This model learns the nuances of speech by analyzing paired audio and transcriptions, enabling it to predict the most probable sounds a speaker would make for any given text. 

The model employs a diffusion process, starting with random noise and progressively de-noising it to closely match the articulation of the speaker from the sample audio. This allows the creation of spoken text that reflects various voices, accents, and speaking styles.

Development and Early Testing

Developed in late 2022, Voice Engine underwent extensive internal testing with a mix of public and private voice samples. This phase was crucial for our alignment and safety research, helping us understand the technical frontiers and establish necessary safeguards. The outputs of these tests were reserved solely for internal assessments.

Collaboration with Policymakers

As part of our iterative deployment framework, we engaged with global policymakers to demonstrate the capabilities and associated risks of synthetic voice models. This engagement started in the summer of 2023, contributing significantly to our safety research and policy development.

Limited Releases and Use Cases

In September 2023, Voice Engine powered ChatGPT’s Voice Mode, using real voices selected through a detailed process involving professional voice actors and industry advisors. In November 2023, we launched a simple TTS API with six preset voices created from 15-second samples by professional voice actors. 

In March 2024, we previewed Voice Engine's custom voice capabilities with trusted partners to raise awareness and support initiatives such as phasing out voice-based authentication, exploring policies for voice protection, educating the public on AI capabilities, and developing techniques for tracking audiovisual content origins.

Safety Measures and Future Directions

Building Voice Engine safely is a top priority. We collaborate with partners across various sectors to incorporate feedback and ensure ethical usage. Partners must adhere to strict usage policies, including prohibiting impersonation without consent, requiring explicit approval from original speakers, and disclosing AI-generated voices to listeners. We also implement safety measures like watermarking and proactive monitoring.

Looking ahead, our latest model, GPT-4o, integrates native audio capabilities, presenting new interaction opportunities and risks. We are actively red-teaming GPT-4o to address potential risks in areas such as social psychology, bias, and misinformation. Our cautious approach includes restricting GPT-4o’s audio outputs to preset voices from professional actors and developing new classifiers to mitigate risks.

Conclusion

We are committed to advancing AI technology responsibly. Our ongoing efforts in developing and deploying Voice Engine and GPT-4o reflect our dedication to safety, transparency, and ethical use. As we continue to innovate, we will keep stakeholders informed and engaged, ensuring that synthetic voice technology benefits society while minimizing potential risks.


Unleashing Creativity: Generating Images with DALL-E 2 Using OpenAI API
Unleashing Creativity: Generating Images with DALL-E 2 Using OpenAI API

Discover how to generate stunning images using DALL-E 2 and the OpenAI API. Unleash your creativity and witness the power of AI in transforming textual prompts into captivating visuals.

reiserx
2 min read
The Rising Role of Artificial Intelligence: Transforming Industries and Shaping the Future
The Rising Role of Artificial Intelligence: Transforming Industries and Shaping the Future

Discover how Artificial Intelligence (AI) revolutionizes industries while navigating ethical considerations. Explore the transformative impact of AI across various sectors.

reiserx
2 min read
Introducing Google AI Generative Search, future of search with Google AI
Introducing Google AI Generative Search, future of search with Google AI

Discover the future of search with Google AI Generative Search, an innovative technology that provides AI-generated results directly within your search experience. Experience cutting-edge AI capabilities and explore a new level of personalized search.

reiserx
3 min read
Exploring the Power of Imagination: Training AI Models to Think Creatively
Exploring the Power of Imagination: Training AI Models to Think Creatively

Harnessing AI's Creative Potential: Explore how researchers are training AI models to think imaginatively, unlocking novel ideas and innovative problem-solving beyond conventional pattern recognition.

reiserx
3 min read
Unleashing the Imagination of AI: Exploring the Technicalities of Training Models to Think Imaginatively
Unleashing the Imagination of AI: Exploring the Technicalities of Training Models to Think Imaginatively

Unleashing AI's Imagination: Explore the technical aspects of cultivating creative thinking in AI models through reinforcement learning, generative models, and transfer learning for groundbreaking imaginative capabilities.

reiserx
2 min read
Bard AI Model Unleashes New Powers: Enhanced Math, Coding, and Data Analysis Capabilities
Bard AI Model Unleashes New Powers: Enhanced Math, Coding, and Data Analysis Capabilities

Bard AI Model now excels in math, coding, and data analysis, with code execution and Google Sheets export for seamless integration.

reiserx
2 min read
Learn More About AI


No comments yet.

Add a Comment:

logo   Never miss a story from us, get weekly updates in your inbox.