logo
episode-header-image
Jun 2024
35m 35s

Rise of the AI PC & local LLMs

Practical AI LLC
About this episode

We’ve seen a rise in interest recently and a number of major announcements related to local LLMs and AI PCs. NVIDIA, Apple, and Intel are getting into this along with models like the Phi family from Microsoft. In this episode, we dig into local AI tooling, frameworks, and optimizations to help you navigate this AI niche, and we talk about how this might impact AI adoption in the longer term.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

  • Ladder Life Insurance100% digital — no doctors, no needles, no paperwork. Don’t put it off until the very last minute to get term coverage life insurance through Ladder. Find out if you’re instantly approved. They’re rated A and A plus. Life insurance costs more as you age, now’s the time to cross it off your list. 
  • Neo4j – Is your code getting dragged down by JOINs and long query times? The problem might be your database…Try simplifying the complex with graphs. Stop asking relational databases to do more than they were made for. Graphs work well for use cases with lots of data connections like supply chain, fraud detection, real-time analytics, and genAI. With Neo4j, you can code in your favorite programming language and against any driver. Plus, it’s easy to integrate into your tech stack. 
  • Fly.ioThe home of Changelog.com — Deploy your apps and databases close to your users. In minutes you can run your Ruby, Go, Node, Deno, Python, or Elixir app (and databases!) all over the world. No ops required. Learn more at fly.io/changelog and check out the speedrun in their docs

Featuring:

Show Notes:

Something missing or broken? PRs welcome!

★ Support this podcast ★
Up next
Aug 19
Inside America’s AI Action Plan
Dan and Chris break down Winning the Race: America's AI Action Plan, issued by the White House in July 2025. Structured as three "pillars" — Accelerate AI Innovation, Build American AI Infrastructure, and Lead in International AI Diplomacy and Security — our dynamic duo unpack th ... Show More
43m 52s
Aug 12
Confident, strategic AI leadership
Allegra Guinan of Lumiera helps leaders turn uncertainty about AI into confident, strategic leadership. In this conversation, she brings some actionable insights for navigating the hype and complexity of AI. The discussion covers challenges with implementing responsible AI practi ... Show More
47m 40s
Aug 8
Educating a data-literate generation
Dan sits down with guests Mark Daniel Ward and Katie Sanders from The Data Mine at Purdue University to explore how higher education is evolving to meet the demands of the AI-driven workforce. They share how their program blends interdisciplinary learning, corporate partnerships, ... Show More
44m 41s
Recommended Episodes
Feb 2024
Gemini vs OpenAI (Practical AI #256)
Google has been releasing a ton of new GenAI functionality under the name “Gemini”, and they’ve officially rebranded Bard as Gemini. We take some time to talk through Gemini compared with offerings from OpenAI, Anthropic, Cohere, etc. We also discuss the recent FCC decision to ba ... Show More
43m 31s
May 2024
Microsoft is all-in on AI: Part 1 (Interview)
Scott Guthrie joins the show this week from Microsoft Build 2024 to discuss Microsoft being all-in on AI. From Copilot, to Azure AI and Prompty, to their developer first focus, leading GitHub, VS Code being the long bet that paid off, to the future of a doctor’s bedside manner as ... Show More
1h 4m
Mar 2021
Green AI 🌲 (Practical AI #124)
Empirical analysis from Roy Schwartz (Hebrew University of Jerusalem) and Jesse Dodge (AI2) suggests the AI research community has paid relatively little attention to computational efficiency. A focus on accuracy rather than efficiency increases the carbon footprint of AI researc ... Show More
1 h
Aug 2022
Tech job interview support group
Struggling through the tech job interview process? We feel you! On this episode, Amal, Nick & Amelia get together to discuss the various ways the interview process disappoints, share their own interview stories, and suggest ways we can improve the process for everyone. Discuss on ... Show More
1h 4m
Nov 2021
From engineering to product (JS Party #203)
Liana Leahy tells Amal and KBall all about her journey from software engineer to product manager. Along the way we learn what a PM does, how to be great at it, how to know if it’s for you, why the role is in such demand these days, and much more. - It’s UNIX, I know this! Discuss ... Show More
1h 5m
Oct 2023
AI's impact on developers (Practical AI #241)
Chris & Daniel are out this week, so we’re bringing you a panel discussion from All Things Open 2023 moderated by Jerod Santo (Practical AI producer and co-host of The Changelog) and featuring keynoters Emily Freeman and James Q Quick. Leave us a comment Changelog++ members save ... Show More
48m 24s
Apr 2021
Mapping the world (Practical AI #131)
Ro Gupta from CARMERA teaches Daniel and Chris all about road intelligence. CARMERA maintains the maps that move the world, from HD maps for automated driving to consumer maps for human navigation. Discuss on Changelog News Changelog++ members get a bonus 1 minute at the end of t ... Show More
53m 10s
May 2024
Is it too late to opt out of AI? (Friends)
Tech lawyer Luis Villa returns to answer our most pressing questions: what’s up with all these new content deals? How did Google think it was a good idea to ship AI Summaries in its current state? Is it too late to opt out of AI? We also discuss AI in Hollywood (spoilers!), posit ... Show More
1h 39m
Jun 2024
Microsoft is all-in on AI: Part 2 (Interview)
Mark Russinovich, Eric Boyd & Neha Batra join us to discuss the state of AI for Microsoft and OpenAI at Microsoft Build 2024. It’s safe to say that Microsoft is all-in on AI. Leave us a comment Changelog++ members save 14 minutes on this episode because they made the ads disappea ... Show More
2h 46m
Sep 2018
AI, Cloud Computing, and Leadership
On today’s episode of IT Visionaries, we are joined by Japjit Tulsi, the CTO of Carta. In his 20 year career, Japjit has led engineering teams at Google, Microsoft, and eBay. He’s helped build products like Google Analytics and, most recently, ShopBot, eBay’s AI tool which combin ... Show More
33m 33s