logo
episode-header-image
Jul 2020
21m 10s

What data transformation library should ...

FRANCESCO GADALETA
About this episode
In this episode I speak about data transformation frameworks available for the data scientist who writes Python code. The usual suspect is clearly Pandas, as the most widely used library and de-facto standard. However when data volumes increase and distributed algorithms are in place (according to a map-reduce paradigm of computation), Pandas no longer perfo ... Show More
Up next
Oct 26
I wrote a chess engine and still can't play chess: AI coding and skill decay (Ep. 317)
I wrote a chess engine that beats real players. I still can't play chess. Developers who hand their coding to AI are heading the same way: they can build the machine but can't play the game. We go through the evidence (Anthropic, METR, Microsoft/CMU), the best counterarguments, a ... Show More
34m 48s
Oct 20
"Rust Is Amazing, as Long as Nobody Looks at It" - Fact-Checking DHH (Ep. 316)
DHH told Rails World that hand-written code is over, that HEY's backend is being AI-rewritten in Rust ("amazing, as long as you never look at it"), and that developer happiness no longer matters. This episode checks his statements. Struggling with AI and Software? Here is my new ... Show More
22m 56s
Oct 13
AI coding agents have a Mythical Man-Month problem (Ep. 315)
Fifty years ago Fred Brooks showed why adding more people to a late project makes it later. Today we do the same thing with tokens — more context, more autonomy, same myth, different currency. Struggling with AI and Software? Here is my new book available for purchase on https:// ... Show More
17m 29s
Recommended Episodes
May 2023
675: Pandas for Data Analysis and Visualization
Wrangling data in Pandas, when to use Pandas, Matplotlib or Seaborn, and why you should learn to create Python packages: Jon Krohn speaks with guest Stefanie Molin, author of Hands-On Data Analysis with Pandas. This episode is brought to you by Posit, the open-source data science ... Show More
1h 8m
Aug 2024
#474: Python Performance for Data Science
See the full show notes for this episode on the website at <a href="https://talkpython.fm/474">talkpython.fm/474</a> 
1h 8m
Sep 2021
Massively Parallel Data Processing In Python Without The Effort Using Bodo
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>Python has beome the de facto language for working with data. That has brought with it a number of challenges having to do with the speed and scalability of working with large volumes of information.There have been many ... Show More
1h 4m
Aug 2020
Building the world's most popular data science platform
Everyone working in data science and AI knows about Anaconda and has probably “conda” installed something. But how did Anaconda get started and what are they working on now? Peter Wang, CEO of Anaconda and creator of PyData and popular packages like Bokeh and DataShader, joins us ... Show More
59m 13s
Nov 2022
Analyze Massive Data At Interactive Speeds With The Power Of Bitmaps Using FeatureBase
<div class="wp-block-jetpack-markdown"><h2>Summary</h2> <p>The most expensive part of working with massive data sets is the work of retrieving and processing the files that contain the raw information. FeatureBase (formerly Pilosa) avoids that overhead by converting the data int ... Show More
59m 25s
Dec 2024
#491: DuckDB and Python: Ducks and Snakes living together
See the full show notes for this episode on the website at <a href="https://talkpython.fm/491">talkpython.fm/491</a> 
1h 2m
Dec 2012
Hadoop
This show covers Hadoop, a set of several languages and libraries for working with big data. Tools of the show: Emacs and Chrome Browser Sync. Books of the show: Hadoop: The Definitive Guide http://tinyurl.com/cp3mw32 and Anathem http://tinyurl.com/cas8bux. 
1h 7m
May 2025
885: Python Polars: The Definitive Guide, with Jeroen Janssens and Thijs Nieuwdorp
Jeroen Janssens and Thijs Nieuwdorp are data frame library Polars’ greatest advocates in this episode with Jon Krohn, where they discuss their book, Python Polars: The Definitive Guide, best practice for using Polars, why Pandas users are switching to Polars for data frame operat ... Show More
1h 15m