logo
episode-header-image
Jun 30
52m 21s

#308 A Framework for GenAI App and Agent...

DATACAMP
About this episode

The enterprise adoption of AI agents is accelerating, but significant challenges remain in making them truly reliable and effective. While coding assistants and customer service agents are already delivering value, more complex document-based workflows require sophisticated architectures and data processing capabilities. How do you design agent systems that can handle the complexity of enterprise documents with their tables, charts, and unstructured information? What's the right balance between general reasoning capabilities and constrained architectures for specific business tasks? Should you centralize your agent infrastructure or purchase vertical solutions for each department? The answers lie in understanding the fundamental trade-offs between flexibility, reliability, and the specific needs of your organization.

Jerry Liu is the CEO and Co-founder at LlamaIndex, the AI agents platform for automating document workflows. Previously, he led the ML monitoring team at Robust Intelligence, did self-driving AI research at Uber ATG, and worked on recommendation systems at Quora.

In the episode, Richie and Jerry explore the readiness of AI agents for enterprise use, the challenges developers face in building these agents, the importance of document processing and data structuring, the evolving landscape of AI agent frameworks like LlamaIndex, and much more.

Links Mentioned in the Show:


New to DataCamp?


Up next
Today
#317 How to Reengineer Your Business Processes with Nelson Repenning, Distinguished Professor at MIT Sloan & Don Kieffer, Senior Lecturer in Operations Management at MIT Sloan
Every day, knowledge workers face the challenge of managing competing priorities and constant interruptions. When systems are managing us rather than us managing them, productivity suffers and morale plummets. But what if the key to improvement isn't complex reorganization but ra ... Show More
1h 6m
Aug 18
#316 Enterprise AI Agents with Jun Qian, VP of Generative AI Services at Oracle
Combining LLMs with enterprise knowledge bases is creating powerful new agents that can transform business operations. These systems are dramatically improving on traditional chatbots by understanding context, following conversations naturally, and accessing up-to-date informatio ... Show More
56m 36s
Aug 13
#315 DataFramed x Alter Everything: Future-Proofing Your Career in AI and Data Analytics | Richie & Megan Bowers
The relationship between AI and data professionals is evolving rapidly, creating both opportunities and challenges. As companies embrace AI-first strategies and experiment with AI agents, the skills needed to thrive in data roles are fundamentally changing. Is coding knowledge st ... Show More
41m 5s
Recommended Episodes
Mar 2025
AI for Good: Generative AI’s Impact & Elevating Women in STEM
In this episode of the Data Science Salon Podcast, host Anna Anisin sits down with two powerhouse leaders shaping the future of AI and inclusivity in tech. First, Jennetta George, SVP of AI at AlixPartners & CEO of Artificially Intelligent, shares her expertise on leveraging Gene ... Show More
38m 25s
Apr 2024
Measuring The Speed of AI Through Benchmarks
David Kanter, Executive Director at MLCommons, discusses the work they’re doing with MLPerf Benchmarks, creating the world’s first industry standard approach to measuring AI speed and safety. He also shares ways they’re testing AI and LLMs for harm, to measure—and, over time, red ... Show More
31m 45s
Aug 2024
AI in Action: From Machine Learning Interpretability to Cybersecurity with Serg Masís and Nirmal Budhathoki
In this DSS Podcast, Anna Anisin welcomes Serg Masís, Climate and Agronomic Data Scientist at Syngenta. Serg, an expert in machine learning interpretability and responsible AI, shares his diverse background and journey into data science. He discusses the challenges of building fa ... Show More
25m 37s
Mar 2025
Bridging AI and Business: Conversational AI & Communicating Data Value
In this episode of the Data Science Salon Podcast, host Anna Anisin sits down with two incredible leaders driving innovation in AI and data science. First, Noelle Russell, CEO at AI Leadership Institute, shares her expertise on Conversational AI and intelligent contact centers. S ... Show More
24m 53s
Oct 2024
Why Human Data is Key to AI: Alexandr Wang from Scale AI
In this conversation with a16z general partner David George, Scale AI founder and CEO Alexandr Wang discusses the three pillars of AI—models, compute, and data—and how creating abundant data is core to the evolution of gen AI. With Scale’s work across enterprise, automotive, and ... Show More
35m 8s
Jan 2025
The Role of Analytics in Shaping the Future of MLOps
Sophia Rowland, Senior Product Manager at SAS, discusses her journey from data science to product management at SAS, focusing on the integration of AI and analytics. She explains the concepts of Model Ops and ML Ops, the challenges organizations face in operationalizing machine l ... Show More
32m 42s
Mar 2024
Driving Manufacturing Efficiency With AI: Pirelli’s Daniele Petecchi
Daniele Petecchi didn’t realize how complex the process of producing tires was until he joined Pirelli, a company that’s been in the business of manufacturing tires for more than 150 years. But now, as head of data management and AI, he’s focused on leveraging the company’s wealt ... Show More
25m 30s
Jun 28
Bridging the Gap: AI and Cybersecurity in the Enterprise
In this episode of Cybersecurity Today, host Jim Love is joined by Krish Banerjee, the Canada Managing Director at Accenture for AI and Data. They begin the discussion with a report from Accenture that highlights the gap between the perceived and actual preparedness for cybersecu ... Show More
50m 50s
Jul 2024
Adopting Generative AI in Healthcare Organizations - with Prashant Natarajan of H2O.ai
Today’s guest is Prashant Natarajan, Vice President of Strategy and Products at H2O.ai. H2O.ai is a tech company whose platform, the H2O AI Cloud, enables businesses, government entities, nonprofits, and academic institutions to make, operate, and innovate with different AI capab ... Show More
33m 21s
Sep 2024
Meet Your New Teammate, AI: Asana’s Saket Srivastava
Saket Srivastava, CIO at work management platform Asana, has had technology roles at organizations such as General Electric, IBM, and Fujitsu, moving from back-end IT services positions to more strategic business leadership roles. Asana has already been working with artificial in ... Show More
35m 17s