logo
episode-header-image
Aug 2017
17m 6s

[MINI] Recurrent Neural Networks

Kyle Polich
About this episode

RNNs are a class of deep learning models designed to capture sequential behavior.  An RNN trains a set of weights which depend not just on new input but also on the previous state of the neural network.  This directed cycle allows the training phase to find solutions which rely on the state at a previous time, thus giving the network a form of memory.  RNNs have been used effectively in language analysis, translation, speech recognition, and many other tasks.

Up next
Jul 27
Social Choice for Fair Recommendations
Recommender systems influence nearly every aspect of our digital lives—but what does it mean for those systems to be fair? Robin Burke joins Data Skeptic to discuss the history of recommender systems, the limitations of optimizing purely for accuracy, and how ideas from social ch ... Show More
42m 56s
Jul 2
News Recommendations
News recommendation algorithms influence far more than what stories we click—they can shape our understanding of the world. In this episode, Kyle Polich speaks with Andreea Iana about responsible AI, filter bubbles, multilingual news recommendation, and her open-source NewsRecLib ... Show More
46m 6s
Jun 23
Give Users the Wheel
What if you could simply tell a recommendation system what you want instead of relying on likes, dislikes, and watch history? Kyle Polich talks with Fuyuan Lyu about the DPR framework, which combines large language models and traditional recommender systems to give users direct c ... Show More
35m 28s
Recommended Episodes
Mar 2017
MLG 009 Deep Learning
tail spinning
51m 28s
Aug 2021
Ai startup 9
deepset works to get more meaningful search results. Deepset uses transfer learning, language models, and question and answer to drive search results. Making sense of text data. deepset is an open source company. It uses natural language processing to answer questions using bert. ... Show More
8m 3s
Apr 2020
Activate deep learning neurons faster with Dynamic RELU (ep. 101)
<p>In this episode I briefly explain the concept behind activation functions in deep learning. One of the most widely used activation function is the rectified linear unit (ReLU).  While there are several flavors of ReLU in the literature, in this episode I speak about a very in ... Show More
22m 18s
Feb 2023
Bayesian probability can learn from the previous probability outcome as data changes
Continuous learning Systems 
9m 29s
May 2025
MLG 036 Autoencoders
Auto encoders are neural networks that compress data into a smaller "code," enabling dimensionality reduction, data cleaning, and lossy compression by reconstructing original inputs from this code. Advanced auto encoder types, such as denoising, sparse, and variational auto encod ... Show More
1h 5m
Apr 2025
Teaching LLMs to Self-Reflect with Reinforcement Learning with Maohao Shen - #726
Today, we're joined by Maohao Shen, PhD student at MIT to discuss his paper, “Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search.” We dig into how Satori leverages reinforcement learning to improve language model reasoning ... Show More
51m 45s
Apr 2024
Physics-Informed Neural Networks (PINNs) - Conor Daly | Podcast #120
💻 Full tutorial: • Physics-Informed Neural Networks (PIN... Physics-Informed Neural Networks (PINNs) integrate known physical laws into neural network learning, particularly for solving differential equations. They embed these laws into the network's loss function, guiding the l ... Show More
1h 5m
Nov 2015
Bidirectional Computation is Effectful
A reconstruction (slides and voiceover) of a talk given at the Summit on Advances in Programming Languages (snapl.org/2015) in May 2015. Bidirectional transformations inherently involve state effects. Modelling them that way allows the incorporation of other effects too, such as ... Show More
5m 16s
Feb 2017
MLG 004 Algorithms - Intuition
<div> <p>Machine learning consists of three steps: prediction, error evaluation, and learning, implemented by training algorithms on large datasets to build models that can make decisions or classifications. The primary categories of machine learning algorithms are supervised, un ... Show More
23m 27s