logo
episode-header-image
Sep 2024
46m 42s

#245 Can We Make Generative AI Cheaper? ...

DATACAMP
About this episode

With AI tools constantly evolving, the potential for innovation seems limitless. But with great potential comes significant costs, and the question of efficiency and scalability becomes crucial. How can you ensure that your AI models are not only pushing boundaries but also delivering results in a cost-effective way? What strategies can help reduce the financial burden of training and deploying models, while still driving meaningful business outcomes? 

Natalia Vassilieva is the VP & Field CTO of ML at Cerebras Systems. Natalia has a wealth of experience in research and development in natural language processing, computer vision, machine learning, and information retrieval. As Field CTO, she helps drive product adoption and customer engagement for Cerebras Systems' wafer-scale AI chips. Previously, Natalia was a Senior Research Manager at Hewlett Packard Labs, leading the Software and AI group. She also served as the head of HP Labs Russia leading research teams focused on developing algorithms and applications for text, image, and time-series analysis and modeling. Natalia has an academic background, having been a part-time Associate Professor at St. Petersburg State University and a lecturer at the Computer Science Center in St. Petersburg, Russia. She holds a PhD in Computer Science from St. Petersburg State University.

Andy Hock is the Senior VP, Product & Strategy at Cerebras Systems. Andy runs the product strategy and roadmap for Cerebras Systems, focusing on integrating AI research, hardware, and software to accelerate the development and deployment of AI models. He has 15 years of experience in product management, technical program management, and enterprise business development; over 20 years of experience in research, algorithm development, and data analysis for image processing; and  9 years of experience in applied machine learning and AI. Previously he was Product Management lead for Data and Analytics for Terra Bella at Google, where he led the development of machine learning-powered data products from satellite imagery. Earlier, he was Senior Director for Advanced Technology Programs at Skybox Imaging (which became Terra Bella following its acquisition by Google in 2014), and before that was a Senior Program Manager and Senior Scientist at Arete Associates. He has a Ph.D. in Geophysics and Space Physics from the University of California, Los Angeles.

In the episode, Richie, Natalia and Andy explore the dramatic recent progress in generative AI, cost and infrastructure challenges in AI, Cerebras’ custom AI chips and other hardware innovations, quantization in AI models, mixture of experts, RLHF, relevant AI use-cases, centralized vs decentralized AI compute, the future of AI and much more. 

Links Mentioned in the Show:


New to DataCamp?


Up next
Jul 8
#309 What Science Fiction Can Tell Us About the Future of AI with Ken Liu, Sci-Fi Author
Technology and human consciousness are converging in ways that challenge our fundamental understanding of creativity and connection. As AI systems become increasingly sophisticated at mimicking human thought patterns, we're entering uncharted territory where machines don't just a ... Show More
1h 17m
Jul 3
Industry Roundup #5: AI Agents Hype vs. Reality, Meta’s $15B Stake in Scale AI, and the First Fully AI-Generated NBA Ad
Welcome to DataFramed Industry Roundups! In this series of episodes, we sit down to discuss the latest and greatest in data & AI. In this episode, with special guest, DataCamp COO Martijn, we touch upon the hype and reality of AI agents in business, the McKinsey vs. Ethan Mollick ... Show More
53m 2s
Jun 30
#308 A Framework for GenAI App and Agent Development with Jerry Liu, CEO at LlamaIndex
The enterprise adoption of AI agents is accelerating, but significant challenges remain in making them truly reliable and effective. While coding assistants and customer service agents are already delivering value, more complex document-based workflows require sophisticated archi ... Show More
52m 21s
Recommended Episodes
Apr 2024
Measuring The Speed of AI Through Benchmarks
David Kanter, Executive Director at MLCommons, discusses the work they’re doing with MLPerf Benchmarks, creating the world’s first industry standard approach to measuring AI speed and safety. He also shares ways they’re testing AI and LLMs for harm, to measure—and, over time, red ... Show More
31m 45s
Oct 2024
Never Too Much AI: Upwork's Andrew Rabinovich
Andrew Rabinovich began his career in technology working on AI applications for cancer detection. He also spent time at Google, working on early iterations of products like Google Glass. Now at Upwork, as vice president and head of AI and machine learning, Rabinovich and his team ... Show More
36m 37s
Aug 2024
AI in Action: From Machine Learning Interpretability to Cybersecurity with Serg Masís and Nirmal Budhathoki
In this DSS Podcast, Anna Anisin welcomes Serg Masís, Climate and Agronomic Data Scientist at Syngenta. Serg, an expert in machine learning interpretability and responsible AI, shares his diverse background and journey into data science. He discusses the challenges of building fa ... Show More
25m 37s
Mar 2025
AI for Good: Generative AI’s Impact & Elevating Women in STEM
In this episode of the Data Science Salon Podcast, host Anna Anisin sits down with two powerhouse leaders shaping the future of AI and inclusivity in tech. First, Jennetta George, SVP of AI at AlixPartners & CEO of Artificially Intelligent, shares her expertise on leveraging Gene ... Show More
38m 25s
Mar 2024
Driving Manufacturing Efficiency With AI: Pirelli’s Daniele Petecchi
Daniele Petecchi didn’t realize how complex the process of producing tires was until he joined Pirelli, a company that’s been in the business of manufacturing tires for more than 150 years. But now, as head of data management and AI, he’s focused on leveraging the company’s wealt ... Show More
25m 30s
Jan 2025
How a 160-Year-Old Startup Uses AI: The Heineken Company’s Ronald den Elzen
After trying his luck at the stock market, Ronald den Elzen, pursued a career in technology leadership instead. Today, as the chief technology and digital officer of The Heineken Company, he encourages his team to think about the legacy beverage company as a 160-year-old startup ... Show More
28m 54s
Sep 2024
Meet Your New Teammate, AI: Asana’s Saket Srivastava
Saket Srivastava, CIO at work management platform Asana, has had technology roles at organizations such as General Electric, IBM, and Fujitsu, moving from back-end IT services positions to more strategic business leadership roles. Asana has already been working with artificial in ... Show More
35m 17s
Jul 2024
Adopting Generative AI in Healthcare Organizations - with Prashant Natarajan of H2O.ai
Today’s guest is Prashant Natarajan, Vice President of Strategy and Products at H2O.ai. H2O.ai is a tech company whose platform, the H2O AI Cloud, enables businesses, government entities, nonprofits, and academic institutions to make, operate, and innovate with different AI capab ... Show More
33m 21s
Jun 11
The AI Minded Path to Scalable and Responsible Innovation Across the Enterprise - with James Raybould of Turing Intelligence
Enterprise leaders are no longer asking if they should adopt AI — the question is how to do it effectively. In this episode, Emerj Editorial Director Matthew DeMello speaks with James Raybould, SVP and GM of Turing Intelligence at Turing, about what distinguishes successful enter ... Show More
31m 18s
Aug 2024
Phaidra’s Jim Gao on Building the Fourth Industrial Revolution with Reinforcement Learning
After AlphaGo beat Lee Sedol, a young mechanical engineer at Google thought of another game reinforcement learning could win: energy optimization at data centers. Jim Gao convinced his bosses at the Google data center team to let him work with the DeepMind team to try. The initia ... Show More
50m 33s