logo
episode-header-image
Apr 2024
31m 45s

Measuring The Speed of AI Through Benchm...

Brave Software
About this episode

David Kanter, Executive Director at MLCommons, discusses the work they're doing with MLPerf Benchmarks, creating the world's first industry standard approach to measuring AI speed and safety. He also shares ways they're testing AI and LLMs for harm, to measure—and, over time, reduce—the potential harms of AI.

Key Takeaways: 

  • How they're using research to help build public confidence in AI and emerging technologies

  • The types of questions enterprise customers should ask their system providers

  • AI safety, and the ways MLCommons is using benchmarks to offer standardized measurements about the potential harm of using AI

  • Unique applications of AI, human creativity as the only limit on where AI can go, and how we can make analog experiences more intelligent in the future

Guest Bio: 

David Kanter is a founder, board member, and the Executive Director of MLCommons where he helps lead the MLPerf benchmarks and other initiatives. He has 16+ years of experience in semiconductors, computing, and machine learning. David founded a microprocessor and compiler startup, was an early employee at Aster Data Systems, and has consulted for industry leaders such as Intel, Nvidia, KLA, Applied Materials, Qualcomm, Microsoft, and many others. He holds a Bachelor of Science degree with honors in Mathematics and a specialization in Computer Science, and a Bachelor of Arts with honors in Economics, both from the University of Chicago.

----------------------------------------------------------------------------------------

About this Show:

The Brave Technologist is here to shed light on the opportunities and challenges of emerging tech. To make it digestible, less scary, and more approachable for all!

Join us as we embark on a mission to demystify artificial intelligence, challenge the status quo, and empower everyday people to embrace the digital revolution. Whether you're a tech enthusiast, a curious mind, or an industry professional, this podcast invites you to join the conversation and explore the future of AI together.

The Brave Technologist Podcast is hosted by Luke Mulks, VP Business Operations at Brave Software—makers of the privacy-respecting Brave browser and Search engine, and now powering AI everywhere with the Brave Search API.

Music by: Ari Dvorin

Produced by: Sam Laliberte

 

Up next
Nov 19
LIVE From Rare Evo: The Hidden World of Web3 Asset Trading
<p dir="ltr">Jay Chrawnna, director of The Kus, dives into the subtle ways people are already using Web3 in everyday transactions (often without realizing it) and what this means for the future of consumer Web3. He explores how gaming projects like FIFA Rivals are redefining digi ... Show More
17m 8s
Nov 12
The $500 Trillion Opportunity: Tokenizing the Real World
Juan Leon, Senior Investment Strategist at Bitwise Asset Management, unpacks the rapid institutional adoption of Bitcoin and Ethereum, fueled by ETFs, regulatory clarity, and the rise of tokenization. He shares key trends shaping the next phase of crypto, including the integratio ... Show More
14m 7s
Nov 5
Pinecone is Democratizing Access to Vector Database Technology
Jack Pertschuck, former Principal Engineer at Pinecone, discusses what vector databases are and why they matter for AI and search applications. He also discusses the challenges of communicating the value of this technology when the problem isn't widely understood. Key Takeaways: ... Show More
30m 9s
Recommended Episodes
Jun 2025
The AI Minded Path to Scalable and Responsible Innovation Across the Enterprise - with James Raybould of Turing Intelligence
<p>Enterprise leaders are no longer asking if they should adopt AI — the question is how to do it effectively. In this episode, Emerj Editorial Director Matthew DeMello speaks with James Raybould, SVP and GM of Turing Intelligence at Turing, about what distinguishes successful en ... Show More
31m 18s
Oct 2024
Never Too Much AI: Upwork's Andrew Rabinovich
Andrew Rabinovich began his career in technology working on AI applications for cancer detection. He also spent time at Google, working on early iterations of products like Google Glass. Now at Upwork, as vice president and head of AI and machine learning, Rabinovich and his team ... Show More
35m 37s
Sep 2024
The Road to Autonomous Intelligence with Andrej Karpathy
Andrej Karpathy joins Sarah and Elad in this week of No Priors. Andrej, who was a founding team member of OpenAI and former Senior Director of AI at Tesla, needs no introduction. In this episode, Andrej discusses the evolution of self-driving cars, comparing Tesla and Waymo’s app ... Show More
44m 16s
Jul 2025
The Future of Humans, AI and Intelligent Technologies
Dr. Ja-Naé Duane talks about her book, coauthored with futurist Steve Fisher, SuperShifts: Transforming How We Live, Learn, and Work in the Age of Intelligence. Ja-Naé is a leading behavioral scientist, an MIT research fellow, and an innovation strategist with deep expertise in e ... Show More
28m 2s
Apr 2025
Bret Taylor: A Vision for AI’s Next Frontier
What happens when one of the most legendary minds in tech delves deep into the real workings of modern AI? A 2-hour long masterclass that you don’t want to miss. Bret Taylor, current chairman of OpenAI, unpacks why AI is transforming software engineering forever, how founders can ... Show More
2h 8m
Aug 2024
AI in Action: From Machine Learning Interpretability to Cybersecurity with Serg Masís and Nirmal Budhathoki
In this DSS Podcast, Anna Anisin welcomes Serg Masís, Climate and Agronomic Data Scientist at Syngenta. Serg, an expert in machine learning interpretability and responsible AI, shares his diverse background and journey into data science. He discusses the challenges of building fa ... Show More
25m 37s
Sep 2024
#245 Can We Make Generative AI Cheaper? With Natalia Vassilieva, Senior VP & Field CTO & Andy Hock, VP, Product & Strategy at Cerebras Systems
<p>With AI tools constantly evolving, the potential for innovation seems limitless. But with great potential comes significant costs, and the question of efficiency and scalability becomes crucial. How can you ensure that your AI models are not only pushing boundaries but also de ... Show More
46m 42s
Sep 23
How Microsoft is Fixing the Biggest AI Agent Problem
Want the guide to create AI Agents? get it here: https://clickhubspot.com/fhc Episode 77: Are we nearing a future where AI agents can autonomously tackle our biggest challenges—while remaining efficient, safe, and truly aligned with human goals? Matt Wolfe (https://x.com/mreflow) ... Show More
30m 8s
Feb 2025
AI and Cyber
In this episode of Life of a CISO, Dr. Eric Cole dives into one of the most pressing topics in cybersecurity today—Artificial Intelligence (AI) and its impact on the role of a Chief Information Security Officer (CISO). He emphasizes that the key to being an effective CISO is thin ... Show More
31m 57s
Sep 19
AI Just Beat the World's Best Coders
AI just scored a historic win in the International Collegiate Programming Contest, with OpenAI’s GPT-5 and Google’s DeepMind outperforming nearly every human team. The discussion focuses on whether this marks a real inflection point for AI, shifting from competition success to th ... Show More
25m 3s