How do you test something that can behave differently every single time?
In this episode, we speak with Amitha Pulijala, Chief Product Officer, and Christoph Börner, VP of Engineering, both at Cyara, about one of the most pressing challenges in conversational AI today. The shift from deterministic, scripted IVRs to generative AI agents is changing how conversational systems are built and tested.
The episode covers how Cyara approaches testing in a non-deterministic world, including using AI agents to test AI agents, and why traditional ideas like test coverage no longer apply in the same way.
Christoph and Amitha share what they are seeing across Cyara’s clients and the wider industry. The discussion unpacks what AI trust means in practice. We talk about hallucinations, model drift, factual accuracy, bias and regulatory compliance.
We explore the economics of generative AI. The cost of running it at scale in production and in testing, and how organisations are rethinking where large language models are necessary versus where smaller, domain-specific models are more effective.
The discussion also highlights how failure can scale in AI systems, where a single bad response can affect thousands of customers.
AVAILABLE ON ALL PODCAST PLAYERS.
Show notes
Get a free pass to Cyara’s Xchange 2026 in Dallas, TX, using code VUX
Find out more about Cyara
Follow Amitha on LinkedIn
Follow Christoph on LinkedIn
Follow Kane on LinkedIn
Take our updated AI Maturity Assessment
Subscribe to VUX World
Subscribe to The AI Ultimatum Substack
