logo
episode-header-image
Jul 2
47m 3s

How AI is changing software engineering ...

Gergely Orosz
About this episode

Supported by Our Partners

•⁠ WorkOS — The modern identity platform for B2B SaaS.

•⁠ Statsig The unified platform for flags, analytics, experiments, and more.

Sonar —  Code quality and code security for ALL code. 

What happens when a company goes all in on AI?

At Shopify, engineers are expected to utilize AI tools, and they’ve been doing so for longer than most. Thanks to early access to models from GitHub Copilot, OpenAI, and Anthropic, the company has had a head start in figuring out what works.

In this live episode from LDX3 in London, I spoke with Farhan Thawar, VP of Engineering, about how Shopify is building with AI across the entire stack. We cover the company’s internal LLM proxy, its policy of unlimited token usage, and how interns help push the boundaries of what’s possible.

In this episode, we cover:

• How Shopify works closely with AI labs

• The story behind Shopify’s recent Code Red

• How non-engineering teams are using Cursor for vibecoding

• Tobi Lütke’s viral memo and Shopify’s expectations around AI

• A look inside Shopify’s LLM proxy—used for privacy, token tracking, and more

• Why Shopify places no limit on AI token spending 

• Why AI-first isn’t about reducing headcount—and why Shopify is hiring 1,000 interns

• How Shopify’s engineering department operates and what’s changed since adopting AI tooling

• Farhan’s advice for integrating AI into your workflow

• And much more!

Timestamps

(00:00) Intro

(02:07) Shopify’s philosophy: “hire smart people and pair with them on problems”

(06:22) How Shopify works with top AI labs 

(08:50) The recent Code Red at Shopify

(10:47) How Shopify became early users of GitHub Copilot and their pivot to trying multiple tools

(12:49) The surprising ways non-engineering teams at Shopify are using Cursor

(14:53) Why you have to understand code to submit a PR at Shopify

(16:42) AI tools' impact on SaaS 

(19:50) Tobi Lütke’s AI memo

(21:46) Shopify’s LLM proxy and how they protect their privacy

(23:00) How Shopify utilizes MCPs

(26:59) Why AI tools aren’t the place to pinch pennies

(30:02) Farhan’s projects and favorite AI tools

(32:50) Why AI-first isn’t about freezing headcount and the value of hiring interns

(36:20) How Shopify’s engineering department operates, including internal tools

(40:31) Why Shopify added coding interviews for director-level and above hires

(43:40) What has changed since Spotify added AI tooling 

(44:40) Farhan’s advice for implementing AI tools

The Pragmatic Engineer deepdives relevant for this episode:

How Shopify built its Live Globe for Black Friday

Inside Shopify's leveling split

Real-world engineering challenges: building Cursor

How Anthropic built Artifacts

See the transcript and other references from the episode at ⁠⁠https://newsletter.pragmaticengineer.com/podcast⁠⁠

Production and marketing by ⁠⁠⁠⁠⁠⁠⁠⁠https://penname.co/⁠⁠⁠⁠⁠⁠⁠⁠. For inquiries about sponsoring the podcast, email podcast@pragmaticengineer.com.



Get full access to The Pragmatic Engineer at newsletter.pragmaticengineer.com/subscribe
Up next
Yesterday
What is a Principal Engineer at Amazon? With Steve Huynh
Supported by Our Partners•⁠ Statsig ⁠ — ⁠ The unified platform for flags, analytics, experiments, and more.• Graphite — The AI developer productivity platform. • Augment Code — AI coding assistant that pro engineering teams love.—Steve Huynh spent 17 years at Amazon, including fo ... Show More
1h 13m
Jun 18
The present, past and future of GitHub
Supported by Our Partners•⁠ Statsig ⁠ — ⁠ The unified platform for flags, analytics, experiments, and more.• Graphite — The AI developer productivity platform. • Augment Code — AI coding assistant that pro engineering teams love—GitHub recently turned 17 years old—but how did it ... Show More
1h 27m
Jun 11
TDD, AI agents and coding with Kent Beck
Supported by Our Partners• Sonar — Code quality and code security for ALL code. •⁠ Statsig ⁠ — ⁠ The unified platform for flags, analytics, experiments, and more.• Augment Code — AI coding assistant that pro engineering teams love.—Kent Beck is one of the most influential figures ... Show More
1h 15m
Recommended Episodes
Apr 8
Uber’s On-Call Copilot with Paarth Chothani and Eduards Sidorovics
At Uber, there are many platform teams supporting engineers across the company, and maintaining robust on-call operations is crucial to keeping services functioning smoothly. The prospect of enhancing the efficiency of these engineering teams motivated Uber to create Genie, which ... Show More
44m 21s
Jun 1
Why Uber’s CPO delivers food on weekends | Sachin Kansal
Sachin Kansal is chief product officer at Uber, where he oversees the Rider, Driver, Delivery, Grocery, and New Verticals product lines used for 33 million daily trips worldwide. He’s been in product for over 25 years (at Google, Palm, Flywheel, and now Uber). He is known for his ... Show More
1h 21m
May 4
Inside Devin: The world’s first autonomous AI engineer that's set to write 50% of its company’s code by end of year | Scott Wu (CEO and co-founder of Cognition)
Scott Wu is the co-founder and CEO of Cognition, the company behind Devin—the world’s first autonomous AI software engineer. Unlike other AI coding tools, Devin works like an autonomous engineer that you can interact with through Slack, Linear, and GitHub, just like with a remote ... Show More
1h 32m
Jul 2024
Justin Sheehy on Being a Responsible Developer in the Age of AI Hype
At the recent InfoQ Dev Summit Boston, Justin Sheehy of Akamai delivered an insightful opening keynote on being a responsible developer in the age of artificial intelligence hype. The talk was aimed at software practitioners who might be feeling overwhelmed by the rapid developme ... Show More
45m 33s
Aug 2024
Lessons from scaling Uber and Opendoor | Brian Tolkin (Head of Product at Opendoor, ex-Uber)
Brian Tolkin is the Head of Product at Opendoor. Previously, he was one of the early employees at Uber, where he was instrumental in launching and growing UberPool, UberHop, and UberExpress and started one of the first product operations teams in tech. In our conversation, we div ... Show More
1h 14m
Dec 2024
Scott Wu - Building Cognition - [Invest Like the Best, EP.402]
My guest today is Scott Wu. Scott is the co-founder and CEO of Cognition, which is an applied AI lab that has created the first AI software engineer, which they call Devin. In just a year since founding Cognition, Devin functions at the level of a junior software engineer, capabl ... Show More
1h 13m
Oct 2024
Becoming a conscious leader: Leading without fear, finding your life’s objective function, and getting better at vision and strategy | John Mark Nickels (Uber, Waymo, DoorDash)
JM Nickels is a Senior Director of Product Management at Uber. Previously, he was Head of Product for Commercialization at Waymo and led product teams at DoorDash. JM is also a coach and advisor focused on conscious leadership. In our conversation, we discuss:• How to sharpen you ... Show More
1h 18m
Dec 2024
Bolt’s Eric Simons on Enabling Everyone to Generate Websites with AI
In this episode of No Priors, Sarah talks with Eric Simons, co-founder and CEO of StackBlitz. The company has experienced explosive growth since the launch 2 months ago of Bolt.new, an AI application that lets users prompt, run, edit, and deploy full-stack applications directly i ... Show More
38m 17s
Sep 2024
Becoming a super IC: Lessons from 12 years as a PM individual contributor | Tal Raviv (Product Lead at Riverside)
Tal Raviv is a product manager at Riverside, where he joined as its first PM. Over his 12-year career as an individual contributor, Tal has been an early PM at Patreon, AppsFlyer, and Wix, working in consumer growth, developer API platforms, and pricing. He started his career by ... Show More
1h 31m