logo
episode-header-image
Dec 2023
26m 25s

What Is Retrieval-Augmented Generation a...

ALEX BOOKER
About this episode

🎙 About the episode


Meet Guil Hernandez 🇺🇸! He is a developer and educator with over 15 years of experience in tech. He's also a Scrimba teacher who is a part of the team bringing you the AI Engineer Path, and in this episode, he's helping us understand retrieval-augmented generation.

In the previous episode, Tom Chant helped us understand the world of AI models. Today, Guil will further teach us how these models work under the hood. AI models don't understand the world like we do. When we interact with them, they turn our inputs into mathematical representations known as embeddings. By creating our own embeddings, we can teach AI to do what we want it to.

Today, we're getting an introduction about making a model aware of your own data source so that that data can be considered for the AI output. For example, using the techniques you'll learn from Guil in this episode, you could connect a model to your customer support conversations so that the model knows what is necessary to answer unique questions about your (or your client's) business.

This is the third episode of our series on AI engineering, introducing Scrimba's AI Engineer Path. This path is your gateway to unlocking the full potential of AI for your projects.

🔗 Connect with Guil

Timestamps

  • Guil focuses on RAG and embeddings (01:42)
  • RAG makes a foundation model aware of your data (03:14)
  • Spotify has been using RAG since 2014 (05:56)
  • How embedding works: embedding model + vector database + generative model (09:00)
  • You're enhancing content retrieved from a database with a generative model (10:26)
  • A foundation model can't just understand text (10:34)
  • What's a vector database? (12:35)
  • Can we make an AI chatbot for the Scrimba podcast? (15:05)
  • You can chunk the files directly at OpenAI now! (16:49)
  • OpenAI's Assistants API (17:33)
  • AI is evolving quickly (19:07)
  • Assistants API does RAG (19:55)
  • What is fine-tuning? (20:39)
  • Differences between RAG and fine-tuning (21:14)
  • Community break with Jan the Producer (23:58)


🧰 Resources Mentioned

⭐️ Leave a Review


If you enjoyed this episode, please leave a 5-star review here and tell us who you want to see on the next podcast.
You can also Tweet Alex from Scrimba at @bookercodes and tell them what lessons you learned from the episode so that he can thank you personally for tuning in 🙏 Or tell Jan he's butchered your name here.

Up next
Jan 2025
End of Season One, and a Message from Alex Booker
So this is goodbye. But do not unsubscribe!It's the end of what will now be known as Season One of the Scrimba podcast! And Alex Booker is stepping down as its host.Over the past 160+ episodes, we have helped you learn to code and land your first job in tech. If you've missed any ... Show More
8m 42s
Sep 2024
Why Open Source Can Be the Perfect Place for New Developers – and How to Get Started, with Deb Goodkin from the FreeBSD Foundation
Meet Deb Goodkin! Deb is the Executive Director of the FreeBSD Foundation. The Foundation supports the FreeBSD project and community. FreeBSD is a powerful open-source operating system known for its reliability and security and used by companies like Netflix to power their server ... Show More
43m 12s
Sep 2024
Tangible Benefits: Why AI Is Here to Stay and How New Developers Can Find the Right Balance, with Sam Julien from Writer
Meet Sam Julien 🇺🇸! Sam is a director of Developer Relations at Writer, a teacher, and the author of Getting Started in Developer Relations. He loves helping people level up their developer advocacy or web development jobs. Recently, he became interested in AI engineering. And ... Show More
44m 53s
Recommended Episodes
Aug 2024
807: CSS Components: Tailwind, Panda, Scoped, Modules, Classes, Variables, CSS-in-JS and Sprinkles!
In this episode of Syntax, Wes and Scott talk about CSS components, including class-based components, CSS modules, scoped CSS, utility CSS, and CSS-in-JS strategies. They share their thoughts, what differentiates these approaches, and why you may (or may not) want to use them. Sh ... Show More
37m 38s
Sep 2024
816: Why Your CSS Sucks
Scott and Wes break down why your CSS might suck—from misusing specificity to not leveraging CSS variables. Tune in as they dive into common pitfalls that are making your stylesheets a hot mess. Show Notes 00:00 Welcome to Syntax! 00:33 Breakdancing in the Olympics. 05:29 Brought ... Show More
28m 1s
Jan 2025
Is Cereal Soup?, the FG Scale, and JS vs CSS with Adam Argyle
This week, Robbie and Chuck talk with Adam Argyle about the quirks of CSS and JavaScript tooling, and modern web development. They discuss why JavaScript often takes center stage over CSS, the funding disparities between them, and what this means for developers. In this episode: ... Show More
1h 12m
Nov 2023
695: 5 New CSS Features You Should Know
In this episode of Syntax, Wes and Scott talk about 5 new CSS features :nth-child(4 of .neat), CSS Motion Path, Scroll Snap, Scroll Driven Animations, and Margin Trim. Show Notes 00:25 Welcome 01:10 :nth-child(4 of .neat) selector list argument of :nth-child and :nth-last-child C ... Show More
24m 30s
May 2014
1. Start Here to Build a Career in Web Development
http://advancedbeginnerchallenge.com – I built a course to get your first job in web development, or upgrade from Junior to mid-level! Tasks - Read Steps 1 & 2 from DevelopAJob.com This site is a good overview of web development. The author provides additional resources some of w ... Show More
24m 14s
Aug 2024
Unorthodox PM wisdom: Automating user insights, unselling job candidates, logging every decision, more | Kevin Yien (Stripe, Square, Mutiny)
Kevin Yien leads product for merchant experiences at Stripe. Before that, he meandered his way from being a technical designer to a product manager, built the restaurants business and ecosystem team at Square, and most recently was head of product and design at Mutiny. He also ma ... Show More
1h 28m
Aug 2024
814: Fundamentals: HTML
In this episode of Syntax, Wes and Scott talk about HTML fundamentals — from basic structure and semantics to practical tips for better accessibility and SEO. They also discuss the difference between block and inline elements, form functionalities, HTML5 elements like dialog and ... Show More
55m 14s
Jul 2024
796: Do We Need JS Frameworks × Are You Over-Engineering? × Webview vs Native
Scott and Wes tackle a variety of audience questions, from the nuances of over-engineering to the energy consumption of AI LLMs. They also discuss the pros and cons of monorepos, frameworks, and the ever-important question: Do you really need to learn all the developer tooling? S ... Show More
58m 34s
Aug 2024
810: Effortless Light and Dark Mode × Theme Styling
In this episode of Syntax, Wes and Scott talk about the latest CSS theming properties and techniques for better controlling light and dark modes, as well as creating comprehensive color systems for applications and websites. Make sure to check out the video version of this episod ... Show More
37m 52s
Jan 2019
#40 Ignacio Anaya on discovering your valuable skills
Ignacio Anaya is a Full Stack Developer at the company BloqInc, a Tech Trainer and a Speaker from Argentina. He's Passionate about code, teaching and field hockey. He mostly works with JavaScript, Vue.js and Blockchain but likes to contribute to many dev communities and Open ... Show More
43m 54s