logo
episode-header-image
Aug 2021
35m 36s

Building the Better, More Scalable Algor...

MISSION
About this episode

An A.I. the model is similar to a boat in that it needs constant maintenance to perform. The reality is  A.I. models need adjusted boundaries and guidelines to remain efficient.  And when you live in a world where everyone is trying to get bigger and faster and have a certain edge, Scott Clark is helping make that possible with his finely-tuned A.I. modeling techniques.

“As you're building up these rules and constructs for how that system will even learn itself, there's a lot of parameters that you need to set and tune. There's all these magical numbers that go into these systems. If you don't have a system of record for this, if you're just throwing things against the wall and seeing what sticks, and then only checking the best one, and you don't have a system of what you tried, what the trade-offs were, which parameters were the most important, and how it traded off different metrics it can seem like a very opaque process. At least that hyper parameter optimization and neural architecture search and kind of tuning part of the process can be a little bit more explainable, a little bit more repeatable and a little bit more optimal.”

More explainable, and more optimal, but most importantly scaleable and reproducible. On this episode of IT Visionaries, Scott, the CEO and Co-founder of SigOpt, a company that’s on a mission to empower modeling systems to reach their fullest potential, explains the basic steps that go into successful models, how his team tweaks and optimizes those models to build more efficient processes. Plus, Scott touches on the future of algorithmic models — including how they will improve and where they struggle. Enjoy this episode.

Main Takeaways

  • Bad Data, Bad!: When you’re building algorithm models you have to not only focus on the data you are putting into those models, but you have to know where that data is coming from and if that data is trustworthy. When you have untrustworthy data — either its coming from an unknown source or is bias in any way — this can lead to models that deliver poor results.
  • Delivering Consistency: While every algorithm needs to be tweaked and tuned at the start, the best way to deliver consistent, scalable algorithmic models is to make sure you are able to define hyper-specific patterns that the algorithm can abide by. When algorithms know what rules they are looking for (such as this person only likes medium sized shirts with stripes) it has a set of hyper-specific boundaries it can operate off of in order to deliver the best results.
  • Where is the Band Conductor?: Algorithms will continue to infiltrate our everyday lives, but the truth is they still need humans to effectively run them, to tune them, and to make sure that the decisions they are making are the right ones. 

---

IT Visionaries is brought to you by the Salesforce Platform - the #1 cloud platform for digital transformation of every experience. Build connected experiences, empower every employee, and deliver continuous innovation - with the customer at the center of everything you do. Learn more at salesforce.com/platform

Up next
Jun 26
What IT Leaders Can Learn from How the Government Buys Tech
IT leaders in regulated industries know the pain of navigating outdated, slow procurement systems – especially when critical missions depend on modern tools. In this episode, Bryana Tucci, Lead of the AWS Marketplace for the US Intelligence Community, shares how government agenci ... Show More
44m 4s
Jun 5
AI in Content Management | Opportunities and Challenges
Feeling buried under content chaos? You're not alone. Ravi Singh, President and Chief Product Officer at Brightspot, joins us to break down how IT leaders can regain control, cut through AI-generated noise, and build scalable, secure content systems. He shares the secrets behind ... Show More
52m 56s
Jun 4
The Future of IT and IT Visionaries
Meet Chris Brandt, the new host of IT Visionaries.In this special episode, outgoing host Albert Chou passes the mic to Chris—a seasoned Technology Strategist with a passion for connecting bold ideas to real business outcomes.Chris’s career spans startups to global enterprises, fr ... Show More
35m 8s
Recommended Episodes
Jul 2023
Tech and AI: 8. The Algorithm
At its simplest, an algorithm is a sequence of step-by-step instructions designed to give a result. They are the building blocks of every computer program and are there to ensure every digital device gives the right results on request. For example, when we type a search query int ... Show More
13m 54s
Dec 2022
From image to 3D model (Ep. 212)
Is it possible to reconstruct a 3D model from a simple image? Under certain constraints, it is! In this episode I tell you how.   Our Sponsors Explore the Complex World of Regulations. Compliance can be overwhelming. Multiple frameworks. Overlapping requirements. Let Arctic Wolf ... Show More
22m 45s
Jan 2022
Automated Data Quality Management Through Machine Learning With Anomalo
Summary Data quality control is a requirement for being able to trust the various reports and machine learning models that are relying on the information that you curate. Rules based systems are useful for validating known requirements, but with the scale and complexity of data i ... Show More
1h 2m
Feb 2020
Data Modeling That Evolves With Your Business Using Data Vault
Summary Designing the structure for your data warehouse is a complex and challenging process. As businesses deal with a growing number of sources and types of information that they need to integrate, they need a data modeling strategy that provides them with flexibility and speed ... Show More
1h 6m
Sep 2021
Declarative Machine Learning Without The Operational Overhead Using Continual
Summary Building, scaling, and maintaining the operational components of a machine learning workflow are all hard problems. Add the work of creating the model itself, and it’s not surprising that a majority of companies that could greatly benefit from machine learning have yet to ... Show More
1h 11m
Feb 2023
Better Science Volume 2: Maps, Metadata, and the Pyramid
Jump in on a second episode of the Better Science series with guest host and Technical Evangelist Justin Emerson interviewing FlashArray engineer Feng Wang about how Pure maps data at scale with a single, scalable data structure. Managing storage in modern times requires a strate ... Show More
46m 3s
Mar 2022
Bayesian Machine Learning with Ravin Kumar (Ep. 191)
This is one episode where passion for math, statistics and computers are merged. I have a very interesting conversation with Ravin,  data scientist at Google where he uses data to inform decisions. He has previously worked at Sweetgreen, designing systems that would benefit team ... Show More
31m 12s
Jan 2024
Pushing The Limits Of Scalability And User Experience For Data Processing WIth Jignesh Patel
Summary Data processing technologies have dramatically improved in their sophistication and raw throughput. Unfortunately, the volumes of data that are being generated continue to double, requiring further advancements in the platform capabilities to keep up. As the sophisticatio ... Show More
50m 26s
Jul 2020
A Reality Check on AI-Driven Medical Assistants
The data science and artificial intelligence community has made amazing strides in the past few years to algorithmically automate portions of the healthcare process. This episode looks at two computer vision algorithms, one that diagnoses diabetic retinopathy and another that cla ... Show More
14 m
Jul 2022
Swiss RE’s SVP of P&C R&D, Jerry Gupta on AI Innovation and Building Revenue-Enhacing Data Models
Swiss RE’s SVP of P&C R&D, Jerry Gupta is a firm believer in the revenue-generating potential and AI and machine learning. On this episode of The Data Chief, Jerry offers his view on innovative data model, frameworks for building and operationalizing these models, what makes a go ... Show More
50m 46s