About this episode
Yesterday
Reducing Data Debt with Agile Ledger Architecture
SummaryIn this episode Christopher Doidge talks about his Agile Ledger Architecture (ALA) approach to data warehousing and how it aims to reduce data debt while shortening the path from raw data to trustworthy business insight. Christopher explained that ALA is not a replacement ... Show More
49m 40s
Sep 15
What Context Really Means in Data Engineering and AI
SummaryIn this episode Soham Mazumdar, co-founder and CEO of Wisdom.ai, talks about what “context” really means in data engineering and AI systems. He explores why context has become such an overloaded term, spanning everything from semantic layers and data catalogs to tribal kno ... Show More
52m 47s
Aug 27
Specialized AI for Data Engineers: Inside Astronomer’s Otto
Summary In this episode Yetunde Dada discusses Otto, Astronomer’s AI agent for Airflow, and the broader challenge of making agentic tooling actually useful for data engineers. She explored why generic coding assistants often fall short in data workflows, how Otto adds the missing ... Show More
45m 30s
Apr 2024
2850: From Data Overload to Insight: Sigma Computing's Blueprint for Business Intelligence
In the dynamic realm of business intelligence and data analytics, the journey from static charts to live, collaborative decision-making platforms illustrates a profound evolution. This episode of Tech Talks Daily welcomes Mike Palmer, CEO of Sigma Computing, to shed light on this ... Show More
29m 31s
May 2022
How to Link Data to Business Outcomes
<p><span style="font-weight: 400;">Every business likes to claim that it is "data-driven" or at least "data-informed," but too often, that's not the way things actually work. Data is relegated to an IT function, siloed and, in some cases, boils down to simply producing more repor ... Show More
17m 32s
Jan 2024
Fivetran COO Unravels Enterprise Data Movement
Automating the collection of dispersed, divergent and disjointed pools of enterprise data on to a single repository to drive analytics and build applications remains complex. In this edition of Bloomberg Intelligence’s Tech Disruptors podcast, Fivetran cofounder and COO Taylor Br ... Show More
40m 15s
Oct 2025
Too much data, not enough insight
Companies have access to more of their data than ever before. But using it to inform real-time decision-making remains a challenge. Chip Kleinheksel talks to Skyworks Solutions’ CIO, Satya Jayadev, and Deloitte's Som Suresh, about how leading companies are turning data into reven ... Show More
31m 37s
Sep 2024
Data for Dummies: A Crash Course for Non-Technical PMs (with Mo Hallaba)
<p>In today's data-driven landscape, organizations often find themselves drowning in a sea of data, yet struggling to glean actionable insights from it. Many companies are eager to label themselves as data-centric, but the reality is that not everyone is equally adept at int ... Show More
23m 23s
Aug 2024
Qlik CEO on Augmenting Data Analytics With AI
AI-fueled product innovation is likely to reset many functions and industries, and companies could look to harness the full power of their data to drive business intelligence. In this episode of the Tech Disruptors podcast, Mike Capone, CEO of Qlik, joins Sunil Rajgopal, senior s ... Show More
40m 42s
Sep 2025
My Playbook for Data-Empowered Operations (261)
<p>This week’s podcast is a quick summary of how to use data in operations. </p><p>You can listen to this podcast <a href='https://jefftowson.com/2025/09/my-playbook-for-data-empowered-operations-tech-strategy-podcast-261/'>here</a>, which has the slides and graphics mentioned. A ... Show More
33m 31s
Dec 2023
LLMs for Data Analysis
In this episode, we are joined by Amir Netz, a Technical Fellow at Microsoft and the CTO of Microsoft Fabric. He discusses how companies can use Microsoft's latest tools for business intelligence. Amir started by discussing how business intelligence has progressed in relevance ov ... Show More
29 m
Feb 2025
Applied AI: Turning Data Into Actionable Insights
<p data-start="120" data-end="430">Data is pouring into your business every second, but where are the insights you need to act on it? Just 27% of business executives in a recent Forrester study said their data and analytics projects produce actionable insights. </p> <p>In this ep ... Show More
33m 44s
Summary
Business intelligence is often equated with a collection of dashboards that show various charts and graphs representing data for an organization. What is overlooked in that characterization is the level of complexity and effort that are required to collect and present that information, and the opportunities for providing those insights in other contexts. In this episode Telmo Silva explains how he co-founded ClicData to bring full featured business intelligence and reporting to every organization without having to build and maintain that capability on their own. This is a great conversation about the technical and organizational operations involved in building a comprehensive business intelligence system and the current state of the market.
Announcements
- Hello and welcome to the Data Engineering Podcast, the show about modern data management
- When you’re ready to build your next pipeline, or want to test out the projects you hear about on the show, you’ll need somewhere to deploy it, so check out our friends at Linode. With their managed Kubernetes platform it’s now even easier to deploy and scale your workflows, or try out the latest Helm charts from tools like Pulsar and Pachyderm. With simple pricing, fast networking, object storage, and worldwide data centers, you’ve got everything you need to run a bulletproof data platform. Go to dataengineeringpodcast.com/linode today and get a $100 credit to try out a Kubernetes cluster of your own. And don’t forget to thank them for their continued support of this show!
- Modern Data teams are dealing with a lot of complexity in their data pipelines and analytical code. Monitoring data quality, tracing incidents, and testing changes can be daunting and often takes hours to days. Datafold helps Data teams gain visibility and confidence in the quality of their analytical data through data profiling, column-level lineage and intelligent anomaly detection. Datafold also helps automate regression testing of ETL code with its Data Diff feature that instantly shows how a change in ETL or BI code affects the produced data, both on a statistical level and down to individual rows and values. Datafold integrates with all major data warehouses as well as frameworks such as Airflow & dbt and seamlessly plugs into CI workflows. Go to dataengineeringpodcast.com/datafold today to start a 30-day trial of Datafold.
- Atlan is a collaborative workspace for data-driven teams, like Github for engineering or Figma for design teams. By acting as a virtual hub for data assets ranging from tables and dashboards to SQL snippets & code, Atlan enables teams to create a single source of truth for all their data assets, and collaborate across the modern data stack through deep integrations with tools like Snowflake, Slack, Looker and more. Go to dataengineeringpodcast.com/atlan today and sign up for a free trial. If you’re a data engineering podcast listener, you get credits worth $3000 on an annual subscription
- Your host is Tobias Macey and today I’m interviewing Telmo Silva about ClicData,
Interview
- Introduction
- How did you get involved in the area of data management?
- Can you describe what ClicData is and the story behind it?
- How would you characterize the current state of the market for business intelligence?
- What are the systems/capabilities that are required to run a full-featured BI system?
- What are the challenges that businesses face in developing in-house capacity for business intelligence?
- Can you describe how the ClicData platform is architected?
- How has it changed or evolved since you first began working on it?
- How are you approaching schema design and evolution in the storage layer?
- How do you handle questions of data security/privacy/regulations given that you are storing the information on behalf of the business?
- In your work with clients what are some of the challenges that businesses are facing when attempting to answer questions and gain insights from their data in a repeatable fashion?
- What are some strategies that you have found useful for structuring schemas or dashboards to make iterative exploration of data effective?
- What are the most interesting, innovative, or unexpected ways that you have seen ClicData used?
- What are the most interesting, unexpected, or challenging lessons that you have learned while working on ClicData?
- When is ClicData the wrong choice?
- What do you have planned for the future of ClicData?
Contact Info
Parting Question
- From your perspective, what is the biggest gap in the tooling or technology for data management today?
Closing Announcements
- Thank you for listening! Don’t forget to check out our other show, Podcast.__init__ to learn about the Python language, its community, and the innovative ways it is being used.
- Visit the site to subscribe to the show, sign up for the mailing list, and read the show notes.
- If you’ve learned something or tried out a project from the show then tell us about it! Email hosts@dataengineeringpodcast.com) with your story.
- To help other people find the show please leave a review on iTunes and tell your friends and co-workers
Links
The intro and outro music is from The Hug by The Freak Fandango Orchestra / CC BY-SA
Support Data Engineering Podcast
