MLOps.community

What if AI could actually remember like humans do?Biswaroop Bhattacharjee joins Demetrios Brinkmann to challenge how we think about memory in AI. From building Cortex—a system inspired by human cognition—to exploring whether AI should forget, this conversation questions the limits of agentic memory and how far we should go in mimicking the mind.Guest speaker: Biswaroop Bhattacharjee - Senior ML Engineer at Prem AIHost :Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]#podcast #aiinfrastructure #aiagents #memory

LLMs at Scale: Infrastructure That Keeps AI Safe, Smart & Affordable // MLOps Podcast #341 with Marco Palladino, Kong's Co-Founder and CTO.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractWhile conversations around AI regulations continue to evolve, the responsibility for AI continues to be with developers. In this episode, Marco Palladino, CTO and co-founder of Kong Inc., explores what it means to build and scale AI responsibly when the rulebook is still being written. He explains that infrastructure should be the frontline defense for enforcing governance, security, and reliability in AI deployments. Marco shares how Kong’s technologies, including AI Gateway and AI Manager, help organizations rein in shadow AI, reduce LLM hallucinations, improve observability, and act as the foundation for agentic workflows.// BioMarco Palladino is an inventor, software developer, and internet entrepreneur. As the CTO and co-founder of Kong, he is Kong’s co-author, responsible for the design and delivery of the company’s products, while also providing technical thought leadership around APIs and microservices within both Kong and the external software community. Prior to Kong, Marco co-founded Mashape in 2010, which became the largest API marketplace and was acquired by RapidAPI in 2017. // Related LinksWebsite: https://konghq.com/ https://www.youtube.com/watch?v=odpPVeQZjHU https://www.thestack.technology/the-big-interview-kong-cto-marco-palladino/ ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Marco on LinkedIn: /marcopalladino/Timestamps:[00:00] Agent-mediated interactions shift[01:17] Kong connectivity and agents[04:36] Transcript cleanup request[08:11] MCP server use cases[12:37] Agent world possibilities [15:55] Business communication evolution[18:55] System optimization[25:36] AI gateway patterns[31:30] Investment decision making[35:54] Building conviction process[41:34] Polished customer conversation[46:37] AI gateway R&D future[50:52] Wrap up

AI Conversations Powered by Prosus Group Unicorn Mafia won the recent hackathon at Raise Summit and explained to me what they built, including all the tech they used under the hood to make their AI agents work. Winners:Charlie Cheesman - Co-founder at 60x.aiMarissa Liu - Tech Lead, Reporting at WatershedAna Shevchenko - Software Engineer II at SpotifyFergus McKenzie-Wilson - Co-founder at 60x.aiAlex Choi - Founding Engineer at MedfinHost:Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

On-Device AI Agents in Production: Privacy, Performance, and Scale // MLOps Podcast #340 with NimbleEdge's Varun Khare, Founder/CEO and Neeraj Poddar, Co-founder & CTO.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractAI agents are transitioning from experimental stages to performing real work in production; however, they have largely been limited to backend task automation. A critical frontier in this evolution is the on-device AI agent, enabling sophisticated, AI-native experiences directly on mobile and embedded devices. While cloud-based AI faces challenges like constant connectivity demands, increased latency, privacy risks, and high operational costs, on-device breaks through these trade-offs.We'll delve into the practical side of building and deploying AI agents with “DeliteAI”, an open-source on-device AI agentic framework. We'll explore how lightweight Python runtimes facilitate the seamless orchestration of end-to-end workflows directly on devices, allowing AI/ML teams to define data preprocessing, feature computation, model execution, and post-processing logic independently of frontend code. This architecture empowers agents to adapt to varying tasks and user contexts through an ecosystem of tools natively supported on Android/iOS platforms, handling all the permissions, model lifecycles, and many more.// BioVarun KhareVarun is the Founder and CEO of NimbleEdge, an AI startup pioneering privacy-first, on-device intelligence. With an academic foundation in AI and neuroscience from UC Berkeley, MPI Frankfurt, and IIT Kanpur, Varun brings deep expertise at the intersection of technology and science. Before founding NimbleEdge, Varun led open-source projects at OpenMined, focusing on privacy-aware AI, and published research in computer vision.Neeraj PoddarNeeraj Poddar is the Co-founder and CTO at NimbleEdge. Prior to NimbleEdge, he was the Co-founder of Aspen Mesh, VP of Engineering at Solo.io, and led the Istio open source community. He has worked on various aspects of AI, networking, security, and distributed systems over the span of his career. Neeraj focuses on the application of open source technologies across different industries in terms of scalability and security. When not working on AI, you can find him playing racquetball and gaining back the calories spent playing by trying out new restaurants. // Related LinksWebsite: https://www.nimbleedge.com/https://www.nimbleedge.com/blog/why-ai-is-not-working-for-youhttps://www.nimbleedge.com/blog/state-of-on-device-aihttps://www.youtube.com/watch?v=Qqj_Nl2MihEhttps://www.linkedin.com/events/7343237917982527488/comments/~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Varun on LinkedIn: /vkkhare/Connect with Neeraj on LinkedIn: /nrjpoddar/Timestamps:[00:00] On-device AI skepticism[02:47] Word suggestion for AI[06:40] Optimizing unique challenges[13:39] LLM on-device challenges[20:34] Agent overlord tension[23:56] AI app constraints[29:23] Siri limitations and trust gap[32:01] Voice-driven app privacy[35:49] Platform lock-in vs aggregation[42:26] On-device AI optimizations[45:38] Wrap up

AI Conversations Powered by Prosus Group  Your AI agent isn’t failing because it’s dumb—it’s failing because you refuse to test it. Chiara Caratelli cuts through the hype to show why evaluations—not bigger models or fancier prompts—decide whether agents succeed in the real world. If you’re not stress-testing, simulating, and iterating on failures, you’re not building AI—you’re shipping experiments disguised as products.Guest speaker: Chiara Caratelli - Data Scientist @ Prosus GroupHost: Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

The DuckLake Lakehouse Format // MLOps Podcast #339 with Hannes Mühleisen, Co-founder and CEO of DuckDB Labs.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractManaging data on Object Stores has been a painful affair. Users had to choose between data swamp chaos or a maze of metadata files with catalog servers on top. DuckLake is a new paradigm for managing data on object stores: First, it uses classical SQL data management systems to manage metadata. Second, actual data is stored in Parquet files on pretty arbitrary storage. Third, processing queries is done client-side, or anywhere really. DuckDB is the first system to integrate with DuckLake using an extension with the same name. Conceptually, DuckLake enables central control over truth while decentralizing compute and storage entirely. DuckLake turns data warehouse architecture upside down by departing from the integrated metadata/compute layer towards a fully disconnected operation with only centralized metadata. For the first time, DuckLake allows a “multi-player” experience with DuckDB, where computation stays fully local, but transactional control is centralized.// BioHannes Mühleisen 🔈 is a creator of the DuckDB database management system and Co-founder and CEO of DuckDB Labs. He is a senior researcher at the Centrum Wiskunde & Informatica (CWI) in Amsterdam. He is also Professor of Data Engineering at Radboud University Nijmegen.// Related LinksWebsite: https://hannes.muehleisen.orgUnleashing Unconstrained News Knowledge Graphs to Combat Misinformation // Robert Caulk // #279 - https://youtu.be/pF8zTI867EI~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Hudson on LinkedIn: /hfmuehleisenTimestamps:[00:00] Spooky ease in tech[00:29] DuckDB and DuckLake[07:50] Pain vs trust factors[13:12] Prioritizing project features[16:16] Platform growth tension[22:06] Building principles[25:26] OSS vs system reliability[30:27] Creative uses of DuckDB[35:35] Tecton product strategy[43:30] Mindset shift[52:25] DuckDB future shifts[55:37] Wrap up

AI Conversations Powered by Prosus Group  Russ d'Sa shares how LiveKit went from a small open-source project during the pandemic to powering voice interfaces for giants like OpenAI. He talks about the turning point when LiveKit teamed up on ChatGPT’s voice features, the challenges of making AI sound human, and why voice could be the future of multimodal AI. It’s a story of chance, big shifts, and building the backbone of tomorrow’s AI.Guest speakers: Russ Dsa - CEO of LiveKitHost: Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]#voiceagents #podcast

AI Conversations Powered by Prosus Group.  Craig Tavares, COO of Buzz High Performance Compute, shares lessons from building GPU cloud infrastructure worldwide. He stresses the role of sovereign mandates, renewable power, and modular cooling in scaling data centers, while highlighting NVIDIA partnerships and orchestration as key to sustaining AI workloads.Guest speaker: Craig Tavares - COO of Buzz HPCHost: Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

Trust at Scale: Security and Governance for Open Source Models // MLOps Podcast #338 with Hudson Buzby, Solutions Architect at JFrog.Appreciate JFrog for their support in bringing this blog to life.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractFor better or for worse, machine learning has traditionally escaped the gaze of security and infrastructure teams, operating outside traditional DevOps practices and not always adhering to organizations' development or security standards. With the introduction of open source catalogs like HuggingFace and Ollama, a new standard has been established for locating, identifying, and deploying machine learning and AI models. But with this new standard comes a plethora of security, governance, and legal challenges that organizations need to address before they can comfortably allow developers to freely build and deploy ML/AI applications. In this conversation, we will discuss ways that enterprise-scale organizations are addressing these challenges to safely and securely build these development environments. // BioHudson Buzby is a solution engineer with an emphasis on MLOps, LLMOps, Big Data, and Distributed Systems, leveraging his expertise to help organizations optimize their machine learning operations and large language model deployments. His role involves providing technical solutions and guidance to enhance the efficiency and effectiveness of AI-driven projects.// Related Linkshttps://www.youtube.com/channel/UCh2hNg76zo3d1qQqTWIQxDg~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Hudson on LinkedIn: /hudson-buzby/Timestamps:[00:00] Value of Centralized Gateway[00:35] Point Break vs Big Lebowski[01:47] AI adoption failure stats[05:12] ML vs Generative AI[12:04] LLM adoption in enterprise[18:08] MLOps Community alternative[23:43] AI governance challenges[27:39] Organizational debt comparison[31:41] AI tool sprawl[35:59] MLOps to platform evolution[40:56] MLOps then vs now[49:48] Model trust and safety[52:19] AI model effectiveness[55:54] Product discovery process[58:38] Wrap up

AI Conversations Powered by Prosus Group  Nishikant Dhanuka talks about what it really takes to make AI agents useful—especially in e-commerce and productivity. From making them smarter with context (like user history and real-time data) to mixing chat and UI for smoother interactions, he breaks down what’s working and what’s not. He also shares why evals matter, how to test with real users, and why AI only succeeds when it actually makes life easier, not more complicated.Guest speaker: Nishikant Dhanuka - Senior Director of AI at Prosus GroupHost: Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]#contextengineering #aiengineer #aiinfrastructure #podcast

The Era of AI Agents in Marketing // MLOps Podcast #337 with Joel Horwitz, Growth Engineer at Neoteric3D.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractWe’re entering a new era in marketing—one powered by AI agents, not just analysts. The rise of tools like Clay, Karrot.ai, 6sense, and Mutiny is reshaping how go-to-market (GTM) teams operate, making room for a new kind of operator: the GTM engineer. This hybrid role blends technical fluency with growth strategy, leveraging APIs, automation, and AI to orchestrate hyper-personalized, scalable campaigns. No longer just marketers, today’s GTM teams are builders—connecting data, deploying agents, and fine-tuning workflows in real time to meet buyers where they are. This shift isn’t just evolution—it’s a replatforming of the entire GTM function.// BioJoel S. Horwitz has been riding the data wave since before it was cool—literally. He spoke at Spark Summit back in 2014 and penned a prescient piece for MIT Tech Review on data science and machine learning before they became boardroom buzzwords. A former big tech executive turned entrepreneur, Joel now runs Neoteric3D (N3D for short), a digital design and data growth agency that helps brands scale with smarts and style. When he’s not architecting next-gen growth strategies, you’ll find him logging long miles on the trail or coaching his sons’ soccer and baseball teams like a champ.// Related LinksWebsite: https://www.neoteric3d.com~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Joel on LinkedIn: /joelshorwitzTimestamps:[00:00] Joel's preferred coffee[00:53] Agentic workflows in marketing[04:26] Agentic AI vs big data[08:24] Creative outreach automation[13:08] LLMs in marketing optimization[17:36] Traffic relevance[23:36] End-to-end AI workflow[28:10] AI in task automation[32:08] AI systems architecting[38:00] AI vs Thought Leadership[43:10] AI as sparring partner[45:22] AI shifts human roles[48:23] Wrap up

Distilling 200+ Hours of NeurIPS: What’s Next for AI // MLOps Podcast #336 with Nikolaos Vasiloglou, VP of Research ML at RelationalAI.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractNikolaos' widely shared analysis on LinkedIn highlighted key insights across agentic AI, scaling laws, LLM development, and more. Now, he’s exploring how AI itself might be trained to automate this process in the future, offering a glimpse into how researchers could harness LLMs to synthesize conferences like NeurIPS in real-time.// BioNikolaos Vasiloglou is VP of Research-ML for RelationalAI, the industry's first knowledge graph coprocessor for the data cloud. Nikolaos has over 20 years of experience implementing high-value machine learning and AI solutions across various industries. // Related LinksWebsite: https://relational.ai/~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Nikolaos on LinkedIn: /vasiloglou/Timestamps:[00:00] Nik's preferred coffee[01:05] Distilling NeurIPS insights[06:43] Choosing research papers[16:49] Agent patterns at NeurIPS[21:16] Interest in agent-based innovation[25:54] Time series forecasting models[28:15] Tabular foundation models[36:25] Verifier challenges and complexity[39:36] Knowledge graph[45:00] Knowledge graph data challenges[47:14] Worldview in knowledge graphs[50:30] Self-serve analytics challenges[56:22] Llama model adaptation comparison[56:59] Wrap up

AI Conversations Powered by Prosus Group  Demetrios chats with Beyang Liu about Sourcegraph’s AMP, exploring how AI coding agents are reshaping development—from IDEs to natural language commands—boosting productivity, cutting costs, and redefining how developers work with code.Guest speaker:Beyang Liu - CTO of SourcegraphHost:Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

AI Conversations Powered by Prosus Group  Stack Overflow is adapting to the AI era by licensing its trusted Q&A corpus, expanding into discussions and enterprise tools, and reinforcing its role as a reliable source as developer trust in AI output declines.Guest speaker:Prashanth Chandrashekar - CEO of Stack OverflowHost:Demetrios Brinkmann - Founder of MLOps Community2025 Developer Survey: https://survey.stackoverflow.co/2025?utm_medium=referral&utm_source=direct-share&utm_campaign=dev-survey-2025&utm_content=MLOps~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

Knowledge is Eventually Consistent // MLOps Podcast #335 with Devin Stein, CEO of Dosu.Grateful to  @Databricks  and  @hyperbolic-labs  for supporting our podcast and helping us keep great conversations going.Join the Community: https://go.mlops.community/YTJoinInGet the newsletter: https://go.mlops.community/YTNewsletter// AbstractAI as a partner in building richer, more accessible written knowledge—so communities and teams can thrive, endure, and expand their reach.// BioDevin is the CEO and Founder of Dosu. Prior to Dosu, Devin was an early engineer and leader at various startups. Outside of work, he is an active open source contributor and maintainer.// Related LinksWebsite: https://github.com/devsteinhttps://www.youtube.com/watch?v=sC8aW47DqPghttps://www.youtube.com/watch?v=PuM0Gd3txfQhttps://www.youtube.com/watch?v=ah6diDQ9wywhttps://www.youtube.com/watch?v=x22FEQic8lg~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Devin on LinkedIn: /devstein/Timestamps:[00:00] Devin's preferred coffee[00:53] Facts agent overview[03:47] Decision state detection[07:55 - 8:41] Databricks ad[08:42] Context-dependent word meanings [15:25] Fact lifecycle management[24:40] Maintaining quality documentation[30:10 - 31:06] Hyperbolic ad[31:07] Agent collaboration scenarios [38:22] Knowledge maintenance[44:10] Deployment and integration strategies[48:13] Flywheel data approach[51:54] Horror story engineering function[54:32] Wrap up

Demetrios chats with Arpita Vats about how LLMs are shaking up recommender systems. Instead of relying on hand-crafted features and rigid user clusters, LLMs can read between the lines—spotting patterns in user behavior and content like a human would. They cover the perks (less manual setup, smarter insights) and the pain points (latency, high costs), plus how mixing models might be the sweet spot. From timing content perfectly to knowing when traditional methods still win, this episode pulls back the curtain on the future of recommendations.// BioArpita Vats is a passionate and accomplished researcher in the field of Artificial Intelligence, with a focus on Natural Language Processing, Recommender Systems, and Multimodal AI. With a strong academic foundation and hands-on experience at leading tech companies such as LinkedIn, Meta, and Staples, Arpita has contributed to cutting-edge projects spanning large language models (LLMs), privacy-aware AI, and video content understanding.She has published impactful research at premier venues and actively serves as a reviewer for top-tier conferences like CVPR, ICLR, and KDD. Arpita’s work bridges academic innovation with industry-scale deployment, making her a sought-after collaborator in the AI research community.Currently, she is engaged in exploring the alignment and safety of language models, developing robust metrics like the Alignment Quality Index (AQI), and optimizing model behavior across diverse input domains. Her dedication to advancing ethical and scalable AI is reflected both in her academic pursuits and professional contributions.// Related Links#recommendersystems #LLMs #linkedin ~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreMLOps Swag/Merch: [https://shop.mlops.community/]Connect with Demetrios on LinkedIn: /dpbrinkmConnect with Arpita on LinkedIn: /arpita-v-0a14a422/Timestamps:[00:00] Smarter Content Recommendations[05:19] LLMs: Next-Gen Recommendations[09:37] Judging LLM Suggestions[11:38] Old vs New Recommenders[14:11] Why LLMs Get Stuck[16:52] When Old Models Win[22:39] After-Booking Rec Magic[23:26] One LLM to Rule Models[29:14] Personalization That Evolves[32:39] SIM Beats Transformers in QA[35:35] Agents Writing Research Papers[37:12] Big-Company Agent Failures[41:47] LinkedIn Posts Fade Faster[46:04] Clustering Shifts Social Feeds[47:01] Vanishing Posts, Replay Mode

Agents in Production [Podcast Limited Series] Episode Nine – Training LLMs, Picking the Right Models, and GPU HeadachesPaul van der Boor and Zulkuf Genc from Prosus join Demetrios to talk about what it really takes to get AI agents running in production. From building solid eval sets to juggling GPU logistics and figuring out which models are worth using (and when), they share hard-won lessons from the front lines. If you're working with LLMs at scale—or thinking about it—this one’s for you.Guest speakers:Paul van der Boor - VP AI at Prosus GroupZulkuf Genc - Director of AI at Prosus GroupHost:Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

Demetrios chats with Paul van der Boor and Bruce Martens from Prosus about the real bottlenecks in AI agent development—not tools, but evaluation and feedback. They unpack when to build vs. buy, the tradeoffs of external vendors, and how internal tools like Copilot are reshaping workflows.Guest speakers:Paul van der Boor - VP AI at Prosus GroupBruce Martens - AI Engineer at Prosus GroupHost:Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

Building AI agents that actually get things done is harder than it looks. Demetrios, Paul, and Dmitri break down what makes agents effective—from smart planning and memory to treating tools, systems, and even people as components. They cover the "react" loop, budgeting for long tasks, sandboxing, and learning from experience. It’s a sharp, practical look at what it really takes to design useful, adaptive AI agents.Guest speakers:Paul van der Boor - VP AI at Prosus GroupDmitri Jarnikov - Senior Director of Data Science at Prosus GroupHost:Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]

Building AI Agents that work is no small feat.In Agents in Production [Podcast Limited Series] - Episode Six, Paul van der Boor and Sean Kenny share how they scaled AI across 100+ companies with Toqan—a tool born from a Slack experiment and grown into a powerful productivity platform. From driving adoption and building super users to envisioning AI employees of the future, this conversation cuts through the hype and gets into what it really takes to make AI work in the enterprise.Guest speakers:Paul van der Boor - VP AI at Prosus GroupSean Kenny - Senior Product Manager at Prosus GroupHost:Demetrios Brinkmann - Founder of MLOps Community~~~~~~~~ ✌️Connect With Us ✌️ ~~~~~~~Catch all episodes, blogs, newsletters, and more: https://go.mlops.community/TYExploreJoin our Slack community [https://go.mlops.community/slack]Follow us on X/Twitter [@mlopscommunity](https://x.com/mlopscommunity) or [LinkedIn](https://go.mlops.community/linkedin)] Sign up for the next meetup: [https://go.mlops.community/register]MLOps Swag/Merch: [https://shop.mlops.community/]