Welcome to the Techmeme Ride Home for Monday, June 10, 2024. I'm Brian McCullough. Today, all the headlines from WWDC, all the AI goodness, even if Apple spent half the time not even mentioning the words artificial intelligence. Also, what if the audio quality of cell phones didn't have to suck? Here's what you missed today in the world of tech. Here you go, WWDC 2024, the event kicked off with Tim Cook live on an actual stage in
front of an actual crowd. They had the usual platitudes about how inspiring the event is, how developers are changing the world. We didn't get to see all that on the live stream. On the live stream, the first thing we saw was a video of a cargo plane flown by Phil Schiller and then Craig Federigie and crew doing a skydive out of the plane into the Apple HQ mission and possible style. And then it was over to Tim Cook on the roof of Apple HQ. We're going
to introduce profound new intelligence capabilities, Tim said, intelligence. That's how they're going to get around saying AI so very, very much. Though one would note that AI could also stand for Apple intelligence, of course. They gave shout outs to Apple TV plus shows and movies. Then it was on to Mike Rockwell and the Vision Pro and Vision OS. Apparently, the Vision Pro has actual apps now while no one was looking, including third party apps.
Who knew? They say over 2000 apps have been created specifically for the Vision Pro at this point. And the new version of the OS is Vision OS 2. You can now spatialize photos from regular photos with advanced machine learning. You can now share photos together or at least I guess look at them together. If you're both on Vision Pro headsets later this year, there's going to be an ultra wide monitor version for the Mac virtual display.
One is bringing out a new spatial lens for their EOS R7 camera. Then it was on to iOS 18. The first big changes there are coming to the home screen as rumored. You can color or tint your widgets and icons to a specific color to complement your wallpaper. You can put icons into any order on the grid. You can move icons anywhere. They don't have to stay strictly on the grid. Control Center allows you to swipe between multiple control center
panels. You can add new controls to the control panel with a control gallery. There's a new controls API that lets developers make controls and also revamp the lock screen buttons and the action buttons. You can hide apps. You have installed on your phone. So no one else knows you're using that particular app. There's a new hidden apps folder that is locked by default. Messages got the ability to schedule messages to send later. Also the ability to bold
underline and italicize text in messages. And now if you have zero cell connection, you can also send messages via satellite. iPhone 14 and later. Also RCS support is officially coming to messages. Mail has gotten on device categorization like a primary inbox, a folder for transactions and receipts, newsletters and promotions. Maps has new topographic maps for hiking and stuff like
that. While it is getting tap to cash basically a way to exchange Apple cash with people without sharing your phone number or email address, the better to share the tab when you're out at a dinner, say, just tap your phones together. There's also a new design for event tickets, which also now have an event guide. The photos app got the biggest redesign ever, according to Apple. There's a powerful new way to filter things like automatically sorting out screenshots or
creating collections, quoting David Pierce at the verge. You know, there's already a lot of AI in this keynote. And by the way, organizing your email, categorizing and collecting photos, that's the stuff everyone is shouting about doing better with AI. And quote, just a note that they haven't mentioned AI yet. Then it was on to the various things like TV OS gets 21 by 9 projector support watch OS is getting a new training mode to measure intensity and duration of workouts.
You can now adjust goals for your activity rings by day of the week. And you can pause ring tracking for a while to keep your streaks alive. Even if you're taking a day off, you can pause now for things like rest days. Your various metrics will be highlighted when you're outside your normal range. There are new features for cycle tracking, pregnancy tracking and heart rate notification, customization, live activities are coming to the watch live translation is also coming to the watch
itself. Then it was on to the iPad, the grid and home screen stuff we just talked about on iOS is coming there to share play will let you remote control another iPad. Yes, the calculator app is finally coming to the iPad with Apple pencil support that got a big cheer from the live crowd apparently. And it's kind of interesting you can write equations using the pencil. And when you write the equal sign, it will solve that equation for you. You can draw like a table of numbers and
get a sum just by drawing a line under a column. This is all called math notes. And speaking of notes, there's a new notes app feature called smart script that makes your messy handwriting better using on device machine learning to, you know, make your handwriting straighter, more legible. You can paste text into a handwritten note and it'll show up in your handwriting. Again, this is all on device AI, but note. They're not mentioning that yet. See what I did there note.
Then it was on the macOS macOS Sequoia, by the way, that's officially the name. Big news here continuity now has iPhone mirroring. You can see and control your iPhone in a window on your Mac. You can interact with your phone even if it's in another room, even if it's locked. In fact, your iPhone stays locked while you're in mirror mode. So no one can see what you're doing with it when you're mirroring it. You can basically pin your phone to your desktop to interact with
it all day long. Grab things like videos and drag them back and forth. And as rumored, there is a new password app. It's coming to the Mac iPhone iPad, Vision OS and Windows. It's built off of keychain, secure sync across devices, auto password fill, all that good stuff. Safari has a highlights mode to highlight things on web pages, keeping you on page, but still offering to summarize and highlight various things on page. Note that this is also on device AI. They're just not, shall we
say, highlighting that again? See what I did there? And finally, though, an hour in, Tim was back to say the words artificial intelligence and large language models for the first time. Quoting Tim, what they are doing, quote, goes beyond artificial intelligence. It's personal intelligence and it's the next big step for Apple. And quote, yes, they are branding it. Apple intelligence. Craig Federegi was back to say the current generation of AI chat tools are cool, but they don't know
enough about you. So Apple intelligence will pull on your personal context. But I mean, they also are going to do this with privacy in mind. They couldn't stop mentioning how they were protecting your privacy as they're going to do what they are about to tell you they're going to do. What does it mean in practice? Well, the iPhone can now prioritize notifications, writing tools can rewrite, summarize, and condense text across mail notes, keynote messages, third party apps even.
You can also create totally original images using photos in your photo library. Imagine creating a mid-journey image like to create an image of your mom looking like a superhero, though there seems to be only three cartoony styles that you can do this in. And Apple intelligence can take actions across your apps. Here are the examples they mentioned. You could say pull up the files and it'll draw them from your email or your messages or whatever. Or you could say play the podcast.
My wife told me about yesterday and it can search for that whether it be an email messages, whatever. And it can quote, orchestrate these and hundreds of other actions for you. It can reference the content on your screen. They say, all of this is on device. It's aware of your personal data without sharing your personal data. There is an on device semantic index to organize and surface
information from across your apps. They say quote, many of these models run on device. There are times though when you need bigger models, servers can help with this and quote, they are saying they created private cloud compute to do this. When you make a request, the device decides if it can handle that request on device or if it needs to go to the cloud. This is going to then send it to those Apple Silicon servers we've spoken about recently. Private cloud compute cryptographically
locks your cloud to your phone. Apple says they can't see what you're doing in this special cloud. And then it was on to Siri. 10 seconds on the clock. How many things can you name that are always growing? Hopefully your relationships, your skills, your customer base. How about your business on Shopify? Shopify is the global commerce platform that helps you sell at every stage of your business from the Launcher Online Shop Stage to the first real-life store stage. All the way to the,
did we just hit a million order stage? Shopify is there to help you grow whether you're selling scented soap or offering outdoor outfits. Shopify helps you sell everywhere from their all-in-one e-commerce platform to their in-person POS system wherever and whatever you're selling. Shopify has got you covered. Shopify helps you turn browsers into buyers with the internet's best converting checkout 36% better on average compared to other leading commerce platforms.
And sell more with less effort thanks to Shopify Magic, your AI powered all-star. And you don't have to just sell your own stuff anymore with Shopify Collective. You can curate products to sell from the brands you love giving your customers more variety and your business more sales. Shopify keeps my 25-year-old e-commerce company running smoothly see what it can do for you. Sign up for a $1 per month trial period at shopify.com slash ride,
all lower case. Go to shopify.com slash ride now to grow your business no matter what stage you're in. Shopify.com slash ride. With almost any project it can be hard to visualize it, right? To keep your vision in your head or share that vision with others, many tools like Gira can be restrictive in the way they organize information. Your ability to see all tasks is restricted by the size of your screen which can make it harder to understand the relationships between tasks.
Especially between different teams or epochs. Well, Miro is a visual collaboration platform that gives your team more clarity through comprehensive functionalities that work together with your existing tool sets to make any sprint ritual, whether it be a stand-up estimation, sprint planning or retrospective, more efficient, clear and ultimately more productive. When I did the AI project, I used Miro to work with my remote team because I wanted it quick and dirty. It was a
sprint and we got it done. With Miro, planning team tasks is smoother and gives everyone a clear sense of mission for every sprint. You can even plan sprints with ease using Miro's planner widget. Connect your team's Gira or Azure instance to your Miro board to visualize and filter tasks by sprint week, status, epic and team. Whether you work in product design, engineering, UX, agile or marketing, bring your team together on Miro. Your first three Miro boards are free when you
sign up today at Miro.com. That's three free boards at MIRO.com. When was the last time Siri got a big platform to make news on? Siri now comes to light with a glowing light around the edge of your screen when you invoke her. There is more natural language interaction with Siri. You can adjust the question you're asking as you ask it. Then there is also the ability for Siri to remember your conversation and have contextual awareness of
previous questions you've asked. You can now type to Siri in case you don't want to talk out loud to Siri. Siri is, as guests, becoming a chatbot. It will have on-screen awareness so that if someone sends you their address, you can just say, hey, add this to a contact card and it'll do it. You don't have to leave the message app. You got that address in to make it happen. It will also take action inside of and across apps. There is an app-intense API. They call all this orchestration.
Another example. If you say, add this photo to Instagram, Siri can just do that for you. Again, don't have to leave the app or make this photo pop. Siri will edit it without having to go to the photos app and do the editing. Siri can find a photo of your driver's license, for example. Extract your ID number and just enter it into a web form for you. Now I will note here, they keep using the future tense. Siri will be able to do blank. This is just a glimpse of what Siri will be
able to do. I wonder how soon stuff like this is actually going to be available to use or if this will be something they'll be rolling out over time. There are now summaries of your email. You can know the gist of an email without actually opening it. There's a smart reply option that will figure out the questions asked of you in an email and write potential answers based on what it knows from your other emails and messages and apps, etc. etc. Messages notifications can now summarize
threads. If you've been ignoring that huge chat chain that 12 people are on, you can find out what you've missed over the last 30 messages that you ignored because you didn't want to be bothered with say hello to Jen Moji, generative AI emojis. Say you want to have a T-Rex writing a surfboard, you can get that as an emoji generated for you. You can even create Jen Mojis of people that you have photos of. There's a new feature in messages called image playground that walks you through
image generating working on device. It all looks very cartoony. I want to underline in the Pixar sense of that word. I want to stress it's cartoony. It's not photorealistic, but it still looks cool. Imagine being able to not just send emojis, which are basically cartoons someone else created, but cartoons that you've created about whatever you want. There's also a dedicated image playground app. There's a new thing called image wand that can turn your rough sketch into a better looking
drawing. Again, not photorealistic, but sketch a table and get a better sketch of a table. There's a cleanup tool in photos that can make objects in a photo disappear, sort of what the Pixel phones do. So, Magic Eraser is now built into photos too, essentially. Searching in photos and videos is getting smarter too. If you were to say, hey,
let's see Leo learning to fish. It will search your photos and videos of that fishing trip you took with Leo and make a video slash photo montage without you having to basically lift a finger. There is new AI recording and transcription and notes, but also in the phone app. They did not rebrand Siri as I've been suggesting, but by the way, Siri does have a new icon. This is all free on all of Apple's new OS's, by the way, and then it was on to the big news.
Chat GPT 40 is integrated right into Siri. When Siri wants to use Chat GPT, it asks you in a prompt. If it can send the question, you just ask to Chat GPT. You have to approve it. The Chat GPT answer comes in as a Siri answer card. This is all free. They say, no need to create a separate account. I wonder how much Apple is paying, you know, OpenAI per usage. Sam Altman was there in the crowd. By the way, lots of people spotted him. He did not come on stage. I'll note. Chat GPT integration
is coming later this year. We also intend to add support for other AI models in the future, they said. This is AI for the rest of us, Apple says. Apple Intelligence is coming to the iPhone 15 Pro and iPad and Max with M1 and later, all with the new OS's of course. And that was it. Tim was back to wrap up after that, which, hmm, I can't wait to see what the online consensus of all this was. Obviously, I'll have that for you tomorrow. Let me squeeze in some non-Apple Nuggets
here real quick before we go. How many times have you thought, sure, everything being on cell phones now is great, except for actually making phone calls. The sound quality of a call these days is, I don't know, I'd say 50% worse than a landline call from 30 years ago. Well, what if it didn't have to be that way? Nokia CEO Peca Lundmark made a phone call using new quote, immersive audio and
video tech that uses 3D sound on a 5G smartphone as part of the 5G advanced standard. Goatting Reuters, we have demonstrated the future of voice calls said Lundmark, who was also present in the room when the first 2G call was made in 1991. Current smartphone calls are monophonic, which compresses audio elements together and sound flatter and less detailed. But this new technology will bring 3D audio
where a caller will hear everything as if they were there with the other person. It is the biggest leap forward in the live voice calling experience since the introduction of monophonic telephony audio used in smartphones and PCs today. Said a Nokia spokesperson, Nokia made the call using a regular smartphone over a 5G network. Apart from person to person immersive calls, this can be used in conference calls where voices of participants can be separated based on their
spatial locations. And a vast majority of smartphones have currently at least two microphones with which this technology can be implemented by transmitting in real time the spatial characteristics of a call, the executive said. The technology is part of the upcoming 5G advanced standard and Nokia aims to get licensing opportunities with the technology which would likely take a few years to be available
widely. Obviously nothing more for you today because I'm hustling to get this recorded and out to you, talk to you tomorrow.