logo
episode-header-image
Oct 2024
59m 56s

Episode 211 - Apple Intelligence and Sir...

Mark and Allen
About this episode

Join us for a fascinating conversation with John G, a seasoned voice developer, as he shares his insights into Apple's approach to AI and the future of Siri. John discusses his journey from helping content creators to the Alexa ecosystem and then into the Apple world, driven by the potential of App Intents and the evolving landscape of Apple Intelligence. We delve into the technical details, exploring how App Intents, the semantic index, and on-device LLMs are shaping the future of app development on Apple platforms. Get ready to unravel the complexities and discover the exciting possibilities of building voice-enabled experiences in the Apple ecosystem.


Learn more:

* https://justbyspeaking.com

* https://justbyspeaking.com/2024/06/14/meet-art-museum.html

* https://machinelearning.apple.com/research/introducing-apple-foundation-models



Timestamps:


[00:00:00] Introduction

[00:01:23] John's Journey into Programming and Apple Development

[00:04:12] Entering the Voice Era with Alexa

[00:10:03] Transitioning Away from Alexa

[00:11:58] Discovering App Intents and the Apple Ecosystem

[00:15:54] Introducing Art Museum: John's First iOS App

[00:18:05] History of Siri and SiriKit

[00:22:25] The Rise of App Intents

[00:27:20] App Intents Implementation Details

[00:30:01] The Pervasiveness of App Intents in iOS

[00:32:40] Unveiling Apple Intelligence

[00:36:10] App Intents and the Semantic Index

[00:40:03] App Intents, Domains, and Parameters

[00:43:42] Adapters and the Foundation Model

[00:46:43] Developer Access to the On-Device Model

[00:49:44] Predefined App Intents (Schemas)

[00:51:34] App Shortcuts and Apple Intelligence

[00:52:56] The Future Potential of Apple Intelligence

[00:59:28] Conclusion


#Siri #GenAI #GenerativeAI #ConversationalAI #VoiceFirst #AppleIntelligence #Bixby #AppIntents #LargeLanguageModel #Apple #iOS #MacOS #AppleDeveloper #SoftwareDevelopment #AppDevelopment


Thumbnail by Imagen3 with prompt:

Cartoon ink and paint, with a touch of tech.

Scene: Two podcast hosts, sitting in front of microphones, smiling and engaging in conversation.

The host on the left is a clean-shaven male caucasian in his early 50s, wearing a light blue polo shirt and glasses.

The host on the right is a young man wearing glasses, an olive-green knit cap,

a short beard and mustache that are light brown, and a dark blue t-shirt.

Warm, inviting lighting.

Background:

A stylized representation of an iPhone displaying a glowing screen border surrounding a symbolic representation of "apple intelligence" the apple logo with a human brain.

Up next
Jul 31
Episode 250 - Five Years Up, Up, and Away in Voice & AI
Join Mark and Allen for a very special 250th episode as they celebrate five years of Two Voice Devs! You won't want to miss the unique, AI-animated opening that takes them to new heights, or the special closing that brings it all home, both created with the help of Veo 3. In betw ... Show More
36m 14s
Jul 24
Episode 249 - Cracking Copilot and the Mysteries of Microsoft 365
In this episode, guest host Andrew Connell, a Microsoft MVP of 21 years, joins Allen to unravel the complexities of Microsoft's AI strategy, particularly within the enterprise. They explore the world of Microsoft 365 Copilot, distinguishing it from the broader AI landscape and co ... Show More
52m 7s
Jul 17
Episode 248 - AI Showdown: Gemini CLI vs. Claude Code CLI
Join Allen Firstenberg and guest host Isaac Johnson, a Google Developer Expert with a deep background in DevOps and SRE, as they dive into the world of command-line AI assistants. In this episode, they compare and contrast two powerful tools: Anthropic's Claude Code CLI and Googl ... Show More
41m 31s
Recommended Episodes
Nov 2024
Making Sense of Agentic AI | ThoughtWorks Birgitta Boeckeler
There’s AI agents. There’s AI tooling. Do either drive business impact or are they just more things your dev team is supposed to stay on top of? Birgitta Boeckeler, Global Lead for AI Assisted Software Delivery at ThoughtWorks, joins the show to discuss the practical applications ... Show More
47m 40s
Sep 2023
Meta’s Quest 3, AI chatbots and Ray-Ban smart glasses
This week, it’s Meta’s turn to highlight AI during its device event. In this episode, Devindra and Cherlynn dive into all of the news from Meta’s Connect 2023 event, where it unveiled Meta AI and accompanying celebrity-powered chatbots. Oh yah, and it introduced the Meta Quest 3 ... Show More
1h 6m
Sep 2024
Study Reveals Vulnerabilities in Alexa, Siri, and Google Assistant to Malicious Commands
In this episode, we explore a recent study that uncovers how popular voice assistants like Alexa, Siri, and Google Assistant are susceptible to malicious commands. We discuss the potential risks and what users can do to protect their devices. Get on the AI Box Waitlist: ⁠⁠⁠https: ... Show More
6m 17s
Nov 2024
SN 1001: Artificial General Intelligence (AGI) - Gmail Temp Addresses, Russia's Internet Off Switch
How Microsoft lured the US Government into a far deeper and expensive dependency upon its cybersecurity solutions. Gmail to offer native throwaway email aliases like Apple and Mozilla. Russia to ban several additional hosting companies and give its big Internet disconnect switch ... Show More
2h 26m
Sep 2024
AI is more than GenAI
GenAI is often what people think of when someone mentions AI. However, AI is much more. In this episode, Daniel breaks down a history of developments in data science, machine learning, AI, and GenAI in this episode to give listeners a better mental model. Don’t miss this one if y ... Show More
40m 3s
Jul 2019
AWS’ new text-to-speech engine sounds like a newscaster
Thanks to modern machine learning techniques, text-to-speech engines have made massive strides over the last few years. It used to be incredibly easy to know that it was a computer that was reading a text and not a human being. But that’s changing quickly. Amazon’s AWS cloud comp ... Show More
2m 48s
Jan 2021
How Salesforce will make Einstein smarter in 2021
Salesforce launched Einstein, its artificial intelligence tool, in 2016. It was memorable because of the marketing materials, featuring a cute cartoon of the world's most misquoted-scientist. It was also memorable because of the unique capabilities Einsten brought to the table. T ... Show More
27m 46s
May 2021
397: Customer Feedback vs. Team Intuition
This week, we talk about the tension between building what customers explicitly ask for versus building towards a team’s internal vision. In The Sidebar, we talk about the lack of public software critique: Why isn’t there an MKBHD equivalent for software design?Golden Ratio Suppo ... Show More
23m 29s