Voice AI and authenticity: current issues and emerging challenges
Author
Date 1 September 2025
Voice technologies are rapidly being integrated into generative AI systems and applications, from customer service chatbots to media production tools.
A new working paper from the ARC Centre of Excellence for Automated Decision-Making and Society (ADM+S) examines how these developments are reshaping everyday life and the profound questions they raise about authenticity.
KEY HIGHLIGHTS
- Understanding Voice AI
- Surveys the rise of AI-driven voice technologies
- Explores how they're used in everyday communication and media
- Highlights questions and debates about authenticity and media
- Risks and Challenges
- Deception in communication and media
- Shifts in cultural interaction with voice
- Digital inequality and labour impacts in knowledge and creative work
- Responses and Future Directions
- Technical and design approaches to support authenticity
- Ethical, legal and accountability frameworks for voice AI
- Critical directions for research, policy, and community empowerment
The paper, Voice AI and authenticity: current issues and emerging challenges surveys the historical evolution of voice AI, reviews the current state of research, and outlines emerging responses to the ethical, legal, cultural and practical challenges it presents.
While synthetic voices promise benefits in communication, media and digital service provision, they also bring heightened risks of deception, shifts in how culture and information are valued, and concerns over digital inequality and labour displacement.
The paper highlights the urgent need for robust frameworks and regulatory responses to guide the responsible development and use of synthetic voices. By addressing the risks alongside the opportunities, the working paper provides researchers, professionals and the wider community with a timely resource for navigating one of the most contested frontiers of generative AI.
Read the full paper Voice AI and authenticity: current issues and emerging challenges.
