DiscoverInsights UnlockedWhy AI in user research isn’t replacing real people (yet) with Mario Callegaro
Why AI in user research isn’t replacing real people (yet) with Mario Callegaro

Why AI in user research isn’t replacing real people (yet) with Mario Callegaro

Update: 2025-12-15
Share

Description

Episode web page: https://bit.ly/3KUDMzV




Episode description:


In this episode of Insights Unlocked, host Amrit Bhachu sits down with Mario Callegaro, founder of Callegaro Research and a leading expert in survey methodology and AI-augmented research. Mario brings a wealth of experience from his 15 years at Google and shares practical, thoughtful guidance on how to responsibly integrate AI tools into UX, market, and survey research workflows.


From the evolving role of the researcher to the risks and potential of synthetic users, this episode unpacks what’s changing, what to be cautious of, and what skills are now essential in the age of AI.


What you’ll learn




  • How AI supports every phase of the research workflow: planning, execution, and activation




  • The role of prompt engineering in getting better insights from AI tools




  • Why synthetic users and synthetic data can't yet replace real human participants




  • What researchers are gaining—and potentially losing—by relying on AI




  • The current limitations of large language models in capturing nuance and variability




  • Practical advice on testing and validating AI tools with known datasets




  • Why transparency, iteration, and responsible experimentation are key




Resources & links


Comments 
In Channel
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Why AI in user research isn’t replacing real people (yet) with Mario Callegaro

Why AI in user research isn’t replacing real people (yet) with Mario Callegaro

UserTesting