logo
episode-header-image
Aug 2017
17m 6s

[MINI] Recurrent Neural Networks

Kyle Polich
About this episode

RNNs are a class of deep learning models designed to capture sequential behavior.  An RNN trains a set of weights which depend not just on new input but also on the previous state of the neural network.  This directed cycle allows the training phase to find solutions which rely on the state at a previous time, thus giving the network a form of memory.  RNNs have been used effectively in language analysis, translation, speech recognition, and many other tasks.

Up next
Sep 9
Recommender Systems Today and Tomorrow
In the final episode of our Recommender Systems season, we explore the growing questions of trust, manipulation, privacy, fairness, sustainability, and user control. From fake reviews and shilling attacks to explainable recommendations and user-selected algorithms, we look at wha ... Show More
22m 46s
Sep 1
Recommender Systems Optimization Goals
In part two of the Data Skeptic Recommender Systems season finale, Kyle asks a deceptively difficult question: what should recommender systems actually optimize for? Drawing on conversations from across the season, the episode explores engagement, filter bubbles, popularity bias, ... Show More
31m 15s
Aug 18
Recommender Systems Origin Story
Where did recommender systems come from, and how do we know when they're actually working? In part one of Data Skeptic's three-part Recommender Systems finale, Kyle traces the field from collaborative filtering and the Netflix Prize to matrix factorization and modern approaches, ... Show More
25m 32s
Recommended Episodes
Mar 2017
MLG 009 Deep Learning
tail spinning
51m 28s
Aug 2021
Ai startup 9
deepset works to get more meaningful search results. Deepset uses transfer learning, language models, and question and answer to drive search results. Making sense of text data. deepset is an open source company. It uses natural language processing to answer questions using bert. ... Show More
8m 3s
Apr 2020
Activate deep learning neurons faster with Dynamic RELU (ep. 101)
<p>In this episode I briefly explain the concept behind activation functions in deep learning. One of the most widely used activation function is the rectified linear unit (ReLU).  While there are several flavors of ReLU in the literature, in this episode I speak about a very in ... Show More
22m 18s
Feb 2023
Bayesian probability can learn from the previous probability outcome as data changes
Continuous learning Systems 
9m 29s
May 2025
MLG 036 Autoencoders
Auto encoders are neural networks that compress data into a smaller "code," enabling dimensionality reduction, data cleaning, and lossy compression by reconstructing original inputs from this code. Advanced auto encoder types, such as denoising, sparse, and variational auto encod ... Show More
1h 5m
Apr 2025
Teaching LLMs to Self-Reflect with Reinforcement Learning with Maohao Shen - #726
Today, we're joined by Maohao Shen, PhD student at MIT to discuss his paper, “Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search.” We dig into how Satori leverages reinforcement learning to improve language model reasoning ... Show More
51m 45s
Apr 2024
Physics-Informed Neural Networks (PINNs) - Conor Daly | Podcast #120
💻 Full tutorial: • Physics-Informed Neural Networks (PIN... Physics-Informed Neural Networks (PINNs) integrate known physical laws into neural network learning, particularly for solving differential equations. They embed these laws into the network's loss function, guiding the l ... Show More
1h 5m
Nov 2015
Bidirectional Computation is Effectful
A reconstruction (slides and voiceover) of a talk given at the Summit on Advances in Programming Languages (snapl.org/2015) in May 2015. Bidirectional transformations inherently involve state effects. Modelling them that way allows the incorporation of other effects too, such as ... Show More
5m 16s
Feb 2017
MLG 004 Algorithms - Intuition
<div> <p>Machine learning consists of three steps: prediction, error evaluation, and learning, implemented by training algorithms on large datasets to build models that can make decisions or classifications. The primary categories of machine learning algorithms are supervised, un ... Show More
23m 27s