logo
episode-header-image
Aug 5
43m 41s

Arvind Jain on Building Glean and the Fu...

Lukas Biewald
About this episode

In this episode of Gradient Dissent, Lukas Biewald sits down with Arvind Jain, CEO and founder of Glean. They discuss Glean's evolution from solving enterprise search to building agentic AI tools that understand internal knowledge and workflows. Arvind shares how his early use of transformer models in 2019 laid the foundation for Glean’s success, well before the term "generative AI" was mainstream.

They explore the technical and organizational challenges behind enterprise LLMs—including security, hallucination suppression—and when it makes sense to fine-tune models. Arvind also reflects on his previous startup Rubrik and explains how Glean’s AI platform aims to reshape how teams operate, from personalized agents to ever-fresh internal documentation.

Follow Arvind Jain: https://x.com/jainarvind

Follow Weights & Biases: https://x.com/weights_biases


Timestamps: 

[00:01:00] What Glean is and how it works 

[00:02:39] Starting Glean before the LLM boom 

[00:04:10] Using transformers early in enterprise search 

[00:06:48] Semantic search vs. generative answers 

[00:08:13] When to fine-tune vs. use out-of-box models 

[00:12:38] The value of small, purpose-trained models 

[00:13:04] Enterprise security and embedding risks

[00:16:31] Lessons from Rubrik and starting Glean 

[00:19:31] The contrarian bet on enterprise search 

[00:22:57] Culture and lessons learned from Google 

[00:25:13] Everyone will have their own AI-powered "team" 

[00:28:43] Using AI to keep documentation evergreen 

[00:31:22] AI-generated churn and risk analysis 

[00:33:55] Measuring model improvement with golden sets

[00:36:05] Suppressing hallucinations with citations 

[00:39:22] Agents that can ping humans for help 

[00:40:41] AI as a force multiplier, not a replacement 

[00:42:26] The enduring value of hard work



Up next
Jul 8
How DeepL Built a Translation Powerhouse with AI with CEO Jarek Kutylowski
In this episode of Gradient Dissent, Lukas Biewald talks with Jarek Kutylowski, CEO and founder of DeepL, an AI-powered translation company. Jarek shares DeepL’s journey from launching neural machine translation in 2017 to building custom data centers and how small teams can not ... Show More
42m 42s
Jun 10
GitHub CEO Thomas Dohmke on Copilot and the Future of Software Development
In this episode of Gradient Dissent, Lukas Biewald sits down with Thomas Dohmke, CEO of GitHub, to talk about the future of software engineering in the age of AI. They discuss how GitHub Copilot was built, why agents are reshaping developer workflows, and what it takes to make to ... Show More
1h 9m
May 20
From Pharma to AGI Hype, and Developing AI in Finance: Martin Shkreli’s Journey
In this episode of Gradient Dissent, Lukas Biewald talks with Martin Shkreli — the infamous "pharma bro" turned founder — about his path from hedge fund manager and pharma CEO to convicted felon and now software entrepreneur. Shkreli shares his side of the drug pricing controvers ... Show More
1h 30m
Recommended Episodes
Aug 2024
AI in Action: From Machine Learning Interpretability to Cybersecurity with Serg Masís and Nirmal Budhathoki
In this DSS Podcast, Anna Anisin welcomes Serg Masís, Climate and Agronomic Data Scientist at Syngenta. Serg, an expert in machine learning interpretability and responsible AI, shares his diverse background and journey into data science. He discusses the challenges of building fa ... Show More
25m 37s
Jun 18
CVS Health and Aible are Delivering Enterprise AI with Rapid Prototyping, Agents, and Reasoning Models - Ep. 261
Tony Ambrozie from CVS Health and Arijit Sengupta from Aible share how their partnership is transforming enterprise AI development through rapid prototyping and human-centered design. Discover their proven methodology for moving from concept to production in just 30 days, why the ... Show More
39m 34s
Jun 9
How to Design an AI-Native Engineering Organization
NLW is joined by Sid Pardeshi and Brian Elliot from Blitzy.com to discuss the radically changes coming to AI engineering organizations. From copilots to agent swarms, this is a conversation about the opportunities and challenges facing all enterprise engineering groups as they lo ... Show More
38m 16s
Jul 8
How I'm Building a Zero-Employee Business with AI
Want to Automate your work with AI? Get the playbook here: https://clickhubspot.com/wgk Episode 66: Can you really build a zero-employee business with AI? Nathan Lands (https://x.com/NathanLands) sits down with John Rush (https://x.com/johnrushx), founder and self-proclaimed buil ... Show More
46 m
May 2024
GSK’s Use of AI in Vaccine Tech, Drug Discovery
GSK’s Chief Digital and Technology Officer Shobie Ramakrishnan discusses how the company is leveraging AI and data models for vaccine development and drug discovery in this episode of Bloomberg Intelligence’s Tech Disruptors podcast. BI’s Health-Care Analyst Sam Fazeli and Techno ... Show More
42m 42s
Sep 2023
The Future of AI in Coding with Bito CEO Amar Goel
In this episode, we dive into the journey of Amar Goel, CEO of Bito AI, and how his company raised $3.2 million to create a platform that trains directly on your codebase. We explore the challenges and opportunities of fundraising, as well as the impact of Bito AI's unique ap ... Show More
22m 54s
Dec 2020
Applying AI to Merchant Services with Adrian Talapan of Fee Navigator: Ep 145
Artificial Intelligence (AI) and Machine Learning have tremendous potential and applications to the business world. On this episode, Adrian Talapan, Co-founder and CEO of FeeNavigator, joins to discuss how they've applied AI to their tool which offers instant merchant statement a ... Show More
43m 23s
Jul 2
Alembic and the Future of AI in Marketing - Ep. 263
Tomás Puig, founder and CEO of Alembic, joins the NVIDIA AI Podcast to discuss the intersection of AI, data, and marketing. He shares how Alembic uses advanced mathematics and AI—particularly spiking neural networks and causal inference—to help brands extract actionable insights ... Show More
39m 44s
May 1
Building Readiness for AI Agents in Healthcare Systems - with Raheel Retiwalla of Productive Edge
Today’s guest is Raheel Retiwalla, Chief Strategy Officer at Productive Edge — a digital transformation consultancy focused on healthcare. Productive Edge works with payers, providers, and health tech firms to leverage AI, data, and modern platforms to streamline operations, cut ... Show More
33m 22s
Jul 2024
Adopting Generative AI in Healthcare Organizations - with Prashant Natarajan of H2O.ai
Today’s guest is Prashant Natarajan, Vice President of Strategy and Products at H2O.ai. H2O.ai is a tech company whose platform, the H2O AI Cloud, enables businesses, government entities, nonprofits, and academic institutions to make, operate, and innovate with different AI capab ... Show More
33m 21s