Enterprise SEO teams waste resources on ineffective LLM.txt files instead of proven protocols. Duane Forrester, former Bing search engineer and founder of UnboundAnswers.com, explains why major crawlers including AI systems still follow established robots.txt standards. The discussion covers proper robots.txt syntax implementation, the default crawl behavior ... Show More
Sep 2024
Rethinking SEO in the age of AI | Eli Schwartz (SEO advisor, author)
<p><strong>Eli Schwartz</strong> is a leading SEO consultant and the author of <em>Product-Led SEO.</em> He has worked with industry giants like Zapier, Tinder, Coinbase, Quora, LinkedIn, and WordPress to build and execute global SEO strategies that significantly enhanced their o ... Show More
1h 55m
May 2025
How Googlebot crawls the web
<p dir="ltr">In this episode of Search Off the Record, Martin and Gary from the Google Search Relations team take a deep dive into how Googlebot and web crawling work—past, present, and future. Through their humorous and thoughtful conversation, they explore how crawling evolved ... Show More
32m 41s
Sep 14
The ultimate guide to AEO: How to get ChatGPT to recommend your product | Ethan Smith (Graphite)
Ethan Smith is the CEO of Graphite—the leading SEO growth agency—and my go-to expert on SEO. After 18 years of mastering traditional SEO, Ethan has been at the forefront of what is called AEO: answer engine optimization, or, more simply, getting your product to show up in ChatGPT ... Show More
1h 11m
Aug 15
Measuring AI code assistants and agents with the AI Measurement Framework
In this episode of Engineering Enablement, DX CTO Laura Tacho and CEO Abi Noda break down how to measure developer productivity in the age of AI using DX’s AI Measurement Framework. Drawing on research with industry leaders, vendors, and hundreds of organizations, they explain ho ... Show More
41m 14s
Sep 20
Navigating the AI Infrastructure Landscape with Haseeb Budhani
<p>In this episode, Jaeden speaks with Haseeb from Rafay about the challenges and opportunities in AI infrastructure. They discuss the importance of self-service consumption for developers, the complexities of competing with hyperscalers, and the need for secure multi-tenancy in ... Show More
18m 35s
Oct 30
Inside The MIT AI Study Everyone Misunderstood (And What It Means For Startups)
MIT's new State of AI in Business report went viral for claiming that 95% of enterprise AI projects fail. But the real story isn't that AI doesn't work — it's just big companies can't build it.In this episode of the Lightcone, Garry, Harj, Diana, and Jared break down what the stu ... Show More
21m 43s
Aug 29
S06.EP14 - Why Brands Shouldn’t Rely on Google (+ How to Actually Get Visibility) with Mordy Oberstein
Google is shifting—and fast. Between AI Overviews, zero-click results, and the rise of LLMs like ChatGPT and Perplexity, traditional search isn’t what it used to be. » Learn more at https://justcreative.com/podcast In this episode, we’re joined by Mordy Oberstein, a leading voice ... Show More
45m 38s