About this episode
Summary
Machine learning is a class of technologies that promise to revolutionize business. Unfortunately, it can be difficult to identify and execute on ways that it can be used in large companies. Kevin Dewalt founded Prolego to help Fortune 500 companies build, launch, and maintain their first machine learning projects so that they can remain competitive in our landscape of constant change. In this episode he discusses why machine learning projects require a new set of capabilities, how to build a team from internal and external candidates, and how an example project progressed through each phase of maturity. This was a great conversation for anyone who wants to understand the benefits and tradeoffs of machine learning for their own projects and how to put it into practice.
Introduction
- Hello and welcome to the Data Engineering Podcast, the show about modern data management
- When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out Linode. With 200Gbit private networking, scalable shared block storage, and a 40Gbit public network, you’ve got everything you need to run a fast, reliable, and bullet-proof data platform. If you need global distribution, they’ve got that covered too with world-wide datacenters including new ones in Toronto and Mumbai. Go to dataengineeringpodcast.com/linode today to get a $20 credit and launch a new server in under a minute.
- Go to dataengineeringpodcast.com to subscribe to the show, sign up for the mailing list, read the show notes, and get in touch.
- To help other people find the show please leave a review on iTunes, or Google Play Music, tell your friends and co-workers, and share it on social media.
- Join the community in the new Zulip chat workspace at dataengineeringpodcast.com/chat
- Your host is Tobias Macey and today I’m interviewing Kevin Dewalt about his experiences at Prolego, building machine learning projects for Fortune 500 companies
Interview
- Introduction
- How did you get involved in the area of data management?
- For the benefit of software engineers and team leaders who are new to machine learning, can you briefly describe what machine learning is and why is it relevant to them?
- What is your primary mission at Prolego and how did you identify, execute on, and establish a presence in your particular market?
- How much of your sales process is spent on educating your clients about what AI or ML are and the benefits that these technologies can provide?
- What have you found to be the technical skills and capacity necessary for being successful in building and deploying a machine learning project?
- When engaging with a client, what have you found to be the most common areas of technical capacity or knowledge that are needed?
- Everyone talks about a talent shortage in machine learning. Can you suggest a recruiting or skills development process for companies which need to build out their data engineering practice?
- What challenges will teams typically encounter when creating an efficient working relationship between data scientists and data engineers?
- Can you briefly describe a successful project of developing a first ML model and putting it into production?
- What is the breakdown of how much time was spent on different activities such as data wrangling, model development, and data engineering pipeline development?
- When releasing to production, can you share the types of metrics that you track to ensure the health and proper functioning of the models?
- What does a deployable artifact for a machine learning/deep learning application look like?
- What basic technology stack is necessary for putting the first ML models into production?
- How does the build vs. buy debate break down in this space and what products do you typically recommend to your clients?
- What are the major risks associated with deploying ML models and how can a team mitigate them?
- Suppose a software engineer wants to break into ML. What data engineering skills would you suggest they learn? How should they position themselves for the right opportunity?
Contact Info
Parting Question
- From your perspective, what is the biggest gap in the tooling or technology for data management today?
Links
The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA
Support Data Engineering Podcast
Today
Blurring Lines: Data, AI, and the New Playbook for Team Velocity
Summary<br />In this crossover episode, Max Beauchemin explores how multiplayer, multi‑agent engineering is transforming the way individuals and teams build data and AI systems. He digs into the shifting boundary between data and AI engineering, the rise of “context as code,” and ... Show More
1 h
Nov 16
State, Scale, and Signals: Rethinking Orchestration with Durable Execution
Summary <br />In this episode Preeti Somal, EVP of Engineering at Temporal, talks about the durable execution model and how it reshapes the way teams build reliable, stateful systems for data and AI. She explores Temporal’s code‑first programming model—workflows, activities, ... Show More
51m 46s
Nov 9
The AI Data Paradox: High Trust in Models, Low Trust in Data
Summary<br />In this episode of the Data Engineering Podcast Ariel Pohoryles, head of product marketing for Boomi's data management offerings, talks about a recent survey of 300 data leaders on how organizations are investing in data to scale AI. He shares a paradox uncovered in ... Show More
51m 35s
Mar 2022
Bayesian Machine Learning with Ravin Kumar (Ep. 191)
<p>This is one episode where passion for math, statistics and computers are merged.
I have a very interesting conversation with Ravin, data scientist at Google where he uses data to inform decisions.</p>
<p>He has previously worked at Sweetgreen, designing systems that would b ... Show More
31m 12s
Jul 2016
Building to Scale: How Yahoo! Turns Machine Learning into Company-Wide Systems
<p class="p1"><span class="s1">Many employers (and employees) are familiar with the 'painful' learning curves of using multiple software products or platforms at once, but these may not be gripes you want to share with Amotz Maimon. This week, we feature an interview recorded at ... Show More
25m 57s
May 2024
If LLMs Do the Easy Programming Tasks - How are Junior Developers Trained? What Have We Done?
In this podcast Michael Stiefel spoke to Anthony Alford and Roland Meertens about the future of software development and the training of new developers, in a world where Large Language Models heavily contribute to software development.
Read a transcript of this interview: https:/ ... Show More
51m 27s
Dec 2022
Machine learning is physics (Ep. 211)
<p>What if we borrowed from physics some theories that would interpret deep learning and machine learning in general?
Here is a list of plausible ways to interpret our beloved ML models and understand why they works, or they don't.
Enjoy the show!
</p>
Our Sponsors
<p>No ... Show More
23m 54s
Apr 2024
Special Series: Tech at Work
Managing technology has never been more challenging. HBR IdeaCast’s new special series, Tech at Work, offers research, stories, and advice to make technology work for you and your team. Listen every other Thursday starting May 2 in the HBR IdeaCast feed, after the regular Tuesday ... Show More
2m 26s
May 2024
Tech at Work: What GenAI Means for Companies Right Now
Managing technology has never been more challenging. HBR IdeaCast’s new special series, Tech at Work, offers research, stories, and advice to make technology work for you and your team. This week: how your team can get the most out of working with generative AI.
37m 20s
Apr 2021
You are the product [RB] (Ep. 147)
In this episode I am with George Hosu from <a href='https://cerebralab.com'>Cerebralab</a>
and we speak about how dangerous it is not to pay for the services you use, and as a consequence how dangerous it is letting an algorithm decide what you like or not.
Our Sponsors
<p>Thi ... Show More
45m 4s
Jul 2022
Episode 5: Level Up with Artificial Intelligence and Machine Learning
Welcome to the Cisco Tech Insiders, a podcast hosted by Cisco Engineers and Architects. The podcast covers topics ranging from the future of technology to the complex network architectures powering personal and organizational technology. Cisco Tech Insiders aims to simplify techn ... Show More
24m 11s
Jul 2020
Nora Jones on Resilience Engineering, Mental Models, and Learning from Incidents
In this podcast, Nora Jones, Co-Founder and CEO at Jeli and co-author of O’Reilly’s “Chaos Engineering: System Resiliency in Practice”, sat down with InfoQ podcast co-host Daniel Bryant. Topics discussed included: chaos engineering and resilience engineering, planning and running ... Show More
36 m