logo
episode-header-image
Sep 2024
46m 42s

#245 Can We Make Generative AI Cheaper? ...

DATACAMP
About this episode

With AI tools constantly evolving, the potential for innovation seems limitless. But with great potential comes significant costs, and the question of efficiency and scalability becomes crucial. How can you ensure that your AI models are not only pushing boundaries but also delivering results in a cost-effective way? What strategies can help reduce the financial burden of training and deploying models, while still driving meaningful business outcomes? 

Natalia Vassilieva is the VP & Field CTO of ML at Cerebras Systems. Natalia has a wealth of experience in research and development in natural language processing, computer vision, machine learning, and information retrieval. As Field CTO, she helps drive product adoption and customer engagement for Cerebras Systems' wafer-scale AI chips. Previously, Natalia was a Senior Research Manager at Hewlett Packard Labs, leading the Software and AI group. She also served as the head of HP Labs Russia leading research teams focused on developing algorithms and applications for text, image, and time-series analysis and modeling. Natalia has an academic background, having been a part-time Associate Professor at St. Petersburg State University and a lecturer at the Computer Science Center in St. Petersburg, Russia. She holds a PhD in Computer Science from St. Petersburg State University.

Andy Hock is the Senior VP, Product & Strategy at Cerebras Systems. Andy runs the product strategy and roadmap for Cerebras Systems, focusing on integrating AI research, hardware, and software to accelerate the development and deployment of AI models. He has 15 years of experience in product management, technical program management, and enterprise business development; over 20 years of experience in research, algorithm development, and data analysis for image processing; and  9 years of experience in applied machine learning and AI. Previously he was Product Management lead for Data and Analytics for Terra Bella at Google, where he led the development of machine learning-powered data products from satellite imagery. Earlier, he was Senior Director for Advanced Technology Programs at Skybox Imaging (which became Terra Bella following its acquisition by Google in 2014), and before that was a Senior Program Manager and Senior Scientist at Arete Associates. He has a Ph.D. in Geophysics and Space Physics from the University of California, Los Angeles.

In the episode, Richie, Natalia and Andy explore the dramatic recent progress in generative AI, cost and infrastructure challenges in AI, Cerebras’ custom AI chips and other hardware innovations, quantization in AI models, mixture of experts, RLHF, relevant AI use-cases, centralized vs decentralized AI compute, the future of AI and much more. 

Links Mentioned in the Show:


New to DataCamp?


Up next
Oct 6
#325 Using Data to Master the Cycles of Leadership with Carolyn Dewar, Global Practice Leader at McKinsey
Leadership in data-driven organizations requires a delicate balance of technical expertise and human understanding. As businesses navigate unprecedented uncertainty in global markets, geopolitics, and technological change, the role of data as a source of truth becomes increasingl ... Show More
43m 13s
Sep 29
#324 Using Behavioral Science to Hack Your Customers Minds with Richard Shotton, Founder at Astroten
Behavioral science is revolutionizing how businesses connect with customers and influence decisions. By understanding the psychological principles that drive human behavior, companies can create more effective marketing strategies and product experiences. But how can you apply th ... Show More
58m 36s
Sep 25
#323 The Evolution of Data Literacy & AI Literacy with Jordan Morrow, Godfather of Data Literacy
Data literacy and AI literacy are becoming essential skills in today's digital landscape. As organizations collect more data and deploy AI solutions, the ability to understand, interpret, and make decisions with these tools is increasingly valuable. But how do we develop these sk ... Show More
48m 3s
Recommended Episodes
Apr 2024
Measuring The Speed of AI Through Benchmarks
David Kanter, Executive Director at MLCommons, discusses the work they’re doing with MLPerf Benchmarks, creating the world’s first industry standard approach to measuring AI speed and safety. He also shares ways they’re testing AI and LLMs for harm, to measure—and, over time, red ... Show More
31m 45s
Oct 2024
Never Too Much AI: Upwork's Andrew Rabinovich
Andrew Rabinovich began his career in technology working on AI applications for cancer detection. He also spent time at Google, working on early iterations of products like Google Glass. Now at Upwork, as vice president and head of AI and machine learning, Rabinovich and his team ... Show More
36m 37s
Aug 2024
AI in Action: From Machine Learning Interpretability to Cybersecurity with Serg Masís and Nirmal Budhathoki
In this DSS Podcast, Anna Anisin welcomes Serg Masís, Climate and Agronomic Data Scientist at Syngenta. Serg, an expert in machine learning interpretability and responsible AI, shares his diverse background and journey into data science. He discusses the challenges of building fa ... Show More
25m 37s
Mar 2025
AI for Good: Generative AI’s Impact & Elevating Women in STEM
In this episode of the Data Science Salon Podcast, host Anna Anisin sits down with two powerhouse leaders shaping the future of AI and inclusivity in tech. First, Jennetta George, SVP of AI at AlixPartners & CEO of Artificially Intelligent, shares her expertise on leveraging Gene ... Show More
38m 25s
Sep 24
AI's Next Frontier: Privacy-Preserving Neural Networks
Jimmy Secretan, CTO of JustWin, explores the latest innovations in privacy-preserving neural networks, and explains how JustWin is leveraging AI to help small businesses win government contracts. He also explores the future directions of AI, and the impact of AI on user autonomy ... Show More
36m 44s
Mar 2024
Driving Manufacturing Efficiency With AI: Pirelli’s Daniele Petecchi
Daniele Petecchi didn’t realize how complex the process of producing tires was until he joined Pirelli, a company that’s been in the business of manufacturing tires for more than 150 years. But now, as head of data management and AI, he’s focused on leveraging the company’s wealt ... Show More
25m 30s
Jan 2025
How a 160-Year-Old Startup Uses AI: The Heineken Company’s Ronald den Elzen
After trying his luck at the stock market, Ronald den Elzen, pursued a career in technology leadership instead. Today, as the chief technology and digital officer of The Heineken Company, he encourages his team to think about the legacy beverage company as a 160-year-old startup ... Show More
28m 54s
Sep 9
Leading across technical domains, strategic deep-dives & applying your skills in new industries w/ Simone Kalmakis #231
How do you apply your leadership skills to a new, mission-driven industry and effectively lead teams across multiple technical domains? In this episode, Simone Kalmakis (VPE @ Viam) shares her playbook for successfully transitioning between industries from health-tech and climate ... Show More
43m 17s
Sep 30
Dylan Patel - Inside the Trillion-Dollar AI Buildout - [Invest Like the Best, EP.442]
My guest today is Dylan Patel. Dylan is the founder and CEO of SemiAnalysis. At SemiAnalysis Dylan tracks the semiconductor supply chain and AI infrastructure buildout with unmatched granularity—literally watching data centers get built through satellite imagery and mapping hundr ... Show More
1h 58m
Jun 2025
Architecting AI-Driven Financial Systems: Innovation at the Intersection of Fintech and Emerging Tech
In this episode of the Data Science Salon Podcast, we sit down with Sasibhushan Rao Chanthati, AVP and Senior Software Engineer at T. Rowe Price, where he’s building the future of finance through intelligent, scalable technologies. Sasi specializes in creating secure digital ecos ... Show More
29m 7s