logo
episode-header-image
Aug 2024
1h 32m

Judy Fan: Reverse Engineering the Human ...

Daniel Bashir
About this episode

Episode 136

I spoke with Judy Fan about:

* Our use of physical artifacts for sensemaking

* Why cognitive tools can be a double-edged sword

* Her approach to scientific inquiry and how that approach has developed

Enjoy—and let me know what you think!

Judy is Assistant Professor of Psychology at Stanford and director of the Cognitive Tools Lab. Her lab employs converging approaches from cognitive science, computational neuroscience, and artificial intelligence to reverse engineer the human cognitive toolkit, especially how people use physical representations of thought — such as sketches and prototypes — to learn, communicate, and solve problems.

Find me on Twitter for updates on new episodes, and reach me at editor@thegradient.pub for feedback, ideas, guest suggestions.

I spend a lot of time on this podcast—if you like my work, you can support me on Patreon :) You can also support upkeep for the full Gradient team/project through a paid subscription on Substack!

Subscribe to The Gradient Podcast:  Apple Podcasts  | Spotify | Pocket Casts | RSSFollow The Gradient on Twitter

Outline:

* (00:00) Intro

* (00:49) Throughlines and discontinuities in Judy’s research

* (06:26) “Meaning” in Judy’s research

* (08:05) Production and consumption of artifacts

* (13:03) Explanatory questions, why we develop visual artifacts, science as a social enterprise

* (15:46) Unifying principles

* (17:45) “Hard limits” to knowledge and optimism

* (21:47) Tensions in different fields’ forms of sensemaking and establishing truth claims

* (30:55) Dichotomies and carving up the space of possible hypotheses, conceptual tools

* (33:22) Cognitive tools and projectivism, simplified models vs. nature

* (40:28) Scientific training and science as process and habit

* (45:51) Developing mental clarity about hypotheses

* (51:45) Clarifying and expressing ideas

* (1:03:21) Cognitive tools as double-edged

* (1:14:21) Historical and social embeddedness of tools

* (1:18:34) How cognitive tools impact our imagination

* (1:23:30) Normative commitments and the role of cognitive science outside the academy

* (1:32:31) Outro

Links:

* Judy’s Twitter and lab page

* Selected papers (there are lots!)

* Overviews

* Drawing as a versatile cognitive tool (2023)

* Using games to understand the mind (2024)

* Socially intelligent machines that learn from humans and help humans learn (2024)

* Research papers 

* Communicating design intent using drawing and text (2024)

* Creating ad hoc graphical representations of number (2024)

* Visual resemblance and interaction history jointly constrain pictorial meaning (2023)

* Explanatory drawings prioritize functional properties at the expense of visual fidelity (2023)

* SEVA: Leveraging sketches to evaluate alignment between human and machine visual abstraction (2023)

* Parallel developmental changes in children’s production and recognition of line drawings of visual concepts (2023)

* Learning to communicate about shared procedural abstractions (2021)

* Visual communication of object concepts at different levels of abstraction (2021)

* Relating visual production and recognition of objects in the human visual cortex (2020)

* Collabdraw: an environment for collaborative sketching with an artificial agent (2019)

* Pragmatic inference and visual abstraction enable contextual flexibility in visual communication (2019)

* Common object representations for visual production and recognition (2018)



Get full access to The Gradient at thegradientpub.substack.com/subscribe
Up next
Dec 2024
2024 in AI, with Nathan Benaich
Episode 142Happy holidays! This is one of my favorite episodes of the year — for the third time, Nathan Benaich and I did our yearly roundup of all the AI news and advancements you need to know. This includes selections from this year’s State of AI Report, some early takes on o3, ... Show More
1h 48m
Dec 2024
Philip Goff: Panpsychism as a Theory of Consciousness
Episode 141I spoke with Professor Philip Goff about:* What a “post-Galilean” science of consciousness looks like* How panpsychism helps explain consciousness and the hybrid cosmopsychist viewEnjoy!Philip Goff is a British author, idealist philosopher, and professor at Durham Univ ... Show More
1 h
Nov 2024
Some Changes at The Gradient
Hi everyone!If you’re a new subscriber or listener, welcome. If you’re not new, you’ve probably noticed that things have slowed down from us a bit recently. Hugh Zhang, Andrey Kurenkov and I sat down to recap some of The Gradient’s history, where we are now, and how things will l ... Show More
34m 25s
Recommended Episodes
Jun 2024
#218 Designing AI Applications with Robb Wilson, Co-Founder & CEO at Onereach.ai
All the hype around generative AI means that every software maker seems to be stuffing chat interfaces into their products whenever they can. For the most part, the jury is still out on whether this is a good idea or not. However, design goes deeper than just the user interface, ... Show More
46m 36s
Aug 2024
He Automated His Sales Job With Ai… So His Boss Promoted Him
Ep. 254 What if you could automate the most mundane parts of your sales job and get promoted for it? Kipp and Kieran are joined by Ethan Dewaal, and dive into how AI is revolutionizing sales practices and boosting productivity. You will learn more on automating product questions ... Show More
40 m
May 2023
The AI Will See You Now: Exploring Biomedical AI and Google’s Med-PaLM2 With Karan Singhal
What if AI could revolutionize healthcare with advanced language learning models? Sarah and Elad welcome Karan Singhal, Staff Software Engineer at Google Research, who specializes in medical AI and the development of MedPaLM2. On this episode, Karan emphasizes the importance of s ... Show More
42m 48s
Jul 8
How I'm Building a Zero-Employee Business with AI
Want to Automate your work with AI? Get the playbook here: https://clickhubspot.com/wgk Episode 66: Can you really build a zero-employee business with AI? Nathan Lands (https://x.com/NathanLands) sits down with John Rush (https://x.com/johnrushx), founder and self-proclaimed buil ... Show More
46 m
Nov 2024
How Startups Can Crush Enterprise AI Sales | E2050
This Week in Startups is brought to you by… LinkedIn Ads. To redeem a $100 LinkedIn ad credit and launch your first campaign, go to http://www.linkedin.com/thisweekinstartups Zendesk. A service-first CRM company with support, sales, and customer engagement products designed to im ... Show More
58m 36s
Sep 2024
#246 AI and the Future of Art with Kent Keirsey, Founder & CEO at Invoke
AI has rapidly emerged as an incredibly transformative technology, and nowhere has its impact been felt more unexpectedly than in the creative arts. Just a decade ago, few would have predicted that AI would evolve from automating routine tasks to generating paintings, music, and ... Show More
47m 9s
Dec 2024
3 AI app ideas that are goldmines (and how to grow them)
In this episode, I am joined by Dan Shipper, co-Founder and CEO of Every, as we explore a wide range of AI startup ideas and business opportunitiesTimestamps:00:00 - Intro 01:12 - Startup Idea 1: Advanced Voice Notes  08:59 - Startup Idea 2: N of 1: Personalized Data Science Mark ... Show More
41m 48s
Jun 20
The Lean Product Playbook 10 Years Later: Product Management in the Age of AI
Product management fundamentals are timeless. But the tools? Completely transformed.Every PM needs to master new workflows in 2025:AI Prototyping - From text to live prototype in minutesDesign Collaboration - Working with designers in the AI ageUser Research - Systematic validati ... Show More
1h 19m
Jul 11
Inside the Rise of Agentic AI
In this episode of the DMI podcast, host ⁠⁠Will Francis⁠⁠ chats with ⁠⁠Dikshant Dave⁠⁠, CEO of Zigment, about the fast-evolving world of agentic AI — autonomous AI agents that execute multi-step marketing and sales tasks. Dikshant shares how agentic AI goes beyond basic automatio ... Show More
42m 16s
Apr 2025
#224 Bret Taylor: A Vision for AI’s Next Frontier
What happens when one of the most legendary minds in tech delves deep into the real workings of modern AI? A 2-hour long masterclass that you don’t want to miss. Bret Taylor, current chairman of OpenAI, unpacks why AI is transforming software engineering forever, how founders can ... Show More
2h 11m