logo
episode-header-image
Jul 2020
21m 10s

What data transformation library should ...

FRANCESCO GADALETA
About this episode
In this episode I speak about data transformation frameworks available for the data scientist who writes Python code. The usual suspect is clearly Pandas, as the most widely used library and de-facto standard. However when data volumes increase and distributed algorithms are in place (according to a map-reduce paradigm of computation), Pandas no longer perfo ... Show More
Up next
Today
Your AI Strategy is Burning Money: Here's How to Fix It (Ep.295)
<p>Most companies don't have an AI problem. They have a decision-making problem. Matt Lea, founder of Schematical and CloudWarGames, has spent nearly 20 years helping tech leaders ship smarter.</p> <p>In this conversation, he breaks down when AI actually makes sense, where AWS co ... Show More
31m 58s
Nov 11
From Tokens to Vectors: The Efficiency Hack That Could Save AI (Ep. 294)
<p>LLMs generate text painfully slow, one low-info token at a time. Researchers just figured out how to compress 4 tokens into smart vectors &amp; cut costs by 44%—with full code &amp; proofs! Meanwhile OpenAI drops product ads, not papers. We explore CALM &amp; why open scienc ... Show More
46m 54s
Oct 30
Why AI Researchers Are Suddenly Obsessed With Whirlpools (Ep. 293)
<p class="whitespace-normal break-words">VortexNet uses actual whirlpools to build neural networks. Seriously. By borrowing equations from fluid dynamics, this new architecture might solve deep learning's toughest problems—from vanishing gradients to long-range dependencies. ... Show More
33m 15s
Recommended Episodes
Sep 2021
Massively Parallel Data Processing In Python Without The Effort Using Bodo
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>Python has beome the de facto language for working with data. That has brought with it a number of challenges having to do with the speed and scalability of working with large volumes of information.There have been many ... Show More
1h 4m
Mar 2024
#454: Data Pipelines with Dagster
See the full show notes for this episode on the website at <a href="https://talkpython.fm/454">talkpython.fm/454</a> 
58m 25s
Nov 2022
Analyze Massive Data At Interactive Speeds With The Power Of Bitmaps Using FeatureBase
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>The most expensive part of working with massive data sets is the work of retrieving and processing the files that contain the raw information. FeatureBase (formerly Pilosa) avoids that overhead by converting the data int ... Show More
59m 25s
Dec 2019
Building The Materialize Engine For Interactive Streaming Analytics In SQL
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>Transactional databases used in applications are optimized for fast reads and writes with relatively simple queries on a small number of records. Data warehouses are optimized for batched writes and complex analytical qu ... Show More
48m 7s
Jul 2023
#422: How data scientists use Python
See the full show notes for this episode on the website at <a href="https://talkpython.fm/422">talkpython.fm/422</a> 
1h 2m
Sep 2022
#382: Apache Superset: Modern Data Exploration Platform
See the full show notes for this episode on the website at <a href="https://talkpython.fm/382">talkpython.fm/382</a> 
1h 8m
Nov 2021
Exploring Processing Patterns For Streaming Data Integration In Your Data Lake
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>One of the perennial challenges posed by data lakes is how to keep them up to date as new data is collected. With the improvements in streaming engines it is now possible to perform all of your data integration in near r ... Show More
52m 53s
Aug 2023
#425: Memray: The endgame Python memory profiler
See the full show notes for this episode on the website at <a href="https://talkpython.fm/425">talkpython.fm/425</a> 
1h 10m
Oct 2023
Reducing The Barrier To Entry For Building Stream Processing Applications With Decodable
<h2>Summary</h2> <p>Building streaming applications has gotten substantially easier over the past several years. Despite this, it is still operationally challenging to deploy and maintain your own stream processing infrastructure. Decodable was built with a mission of eliminat ... Show More
1h 8m