Welcome to the Techmeme Ride Home for Tuesday, December 26, 2023. I'm Brian McCullough. Today, Apple's whole AI strategy has been coming into focus these last couple of weeks. Two stories on this, including Apple's first announced LLM. Open AI is fundraising again. Hackers are targeting gaming studios again, and President Biden didn't deliver the pardon, so what is this patent case against the Apple Watch? I'll explain. Here's what you missed today
in the world of tech. In a recent interview on CNBC, Apple's Johnny Shruji and John Ternis were asked if they were worried, Apple was falling behind in AI. Both of them just chuckled and said, not too worried. Yeah, you had to know Apple wasn't sleeping on AI, and increasingly their belated entry into the artificial intelligence
race is coming into focus. Researchers from Apple and Columbia University have released Ferret, an open source multi-modal LLM that can recognize and describe any shape in an image. They did so back in October, and nobody noticed until now. Quoting Venture Beat. The company released two new research papers introducing new techniques for 3D avatars
and efficient language model inference. The advancements were hailed as potentially enabling more immersive visual experiences and allowing complex AI systems to run on consumer devices, such as the iPhone and iPad. Many in the AI community who belatedly noticed the ferret release celebrated Apple's unexpected entry into the open source LLM landscape, especially
since Apple has traditionally been known as a walled garden. This morning, Bart Tewitt, who runs a European non-profit focused on open source AI in medicine posted on X, I somehow missed this, he wrote. Apple joined the open source AI community in October. Ferret's introduction is a testament to Apple's commitment to impactful AI research, solidifying
its place as a leader in the multi-modal AI space. PS, I'm looking forward to the day when local large language models or LLLMs run on my iPhone as an integrated service of a redesigned iOS and quote. So Apple phones already have those custom neurochips in them that excel at running machine learning, right? If they can run this LLM locally on device that would satisfy their security and privacy bonafides, more on that in the next segment, what's interesting is how they
did this. The name of the paper is efficient large language model inference with limited memory. As Lao Kai said on Threads, quote, they have proposed an inference cost model that coordinates with the behavior of flash memory usage, guiding optimization into key areas, reducing the amount of data transferred from flash memory and reading data in larger, more continuous blocks.
These methods collectively enable running models up to twice the size of the available DRAM with a 4-to-5x and 20-to-25x increase in inference speed compared to native loading approaches in CPU and GPU respectively. And by open sourcing this is Apple opening the door to developers around the world, building out this technique so that AI can live on hardware, even small hardware, even on smartphones, not in a data center. That would make sense. Microsoft and Amazon and Google all
make their money in the cloud. Apple makes its money selling hardware would be wild if this is a strategic move to shift AI to local hardware and aviate data centers. Long way away from that, but still as CSPen said on Threads, quote, do you see where Apple is going if they can get mixture of experts to run at 2x in the available DRAM and get 20-to-25x increases in inference, you could run mixed troll at top speed on a MacBook paralleling GPT 3.5 performance on a consumer
laptop, end quote. Interesting that Apple is embracing open source too, but if they integrate LLMs at the OS level, then why not? As Bart DeWitt said on Twitter, quote, with the advancement of edge AI technology becoming a reality Microsoft reported annual spending of $50 billion on data centers needs to be reexamined. So sort of shot and chaser to that whole, Apple has its own LLM
story. Sources also say Apple has discussed multi-year deals with NBC News, Konday Nast, IAAC, and other media organizations to train its generative AI systems on those various companies news articles. Now, we've talked about this recently. Remember, OpenAI just signed a deal with Axel Springer, but that's the point. Weirdly, Apple find itself in basically the same position as OpenAI. They have to pay up to get data to train on. Meta doesn't
have this problem. They have all the data from Facebook, from Instagram, from their users. Google has all the web that their search engine has crawled and they have YouTube. But suddenly, Apple's vaunted obsession with user privacy, which has been such an advantage for them for years, means they can't access the data. There are billions of users produce every day to train on
their forthcoming AI. So Apple has to pay up to others. Of course, they can afford it, but still quoting the New York Times, the technology giant has flooded multi-year deals worth at least $50 million to license the archives of news articles, said the people with knowledge of the talks who spoke on the condition of anonymity to discuss sensitive negotiations.
The news organizations contacted by Apple include Konday Nast, publisher of Vogue and The New Yorker, NBC News, and IAC, which owns people that daily beasts and better homes and gardens. Some of the publishers contacted by Apple were Luke Worm on the overture. After years of Onigain, off-again commercial deals with tech companies like Meta, the owner of Facebook, publishers have grown wary of jumping into business with Silicon Valley.
Apparently, the publishers were nervous about the extensive scope of Apple's proposed terms, the core of the proposal involved a wide-ranging license for the publisher's entire archive of content. This raised the alarm bells about the potential legal liabilities publishers could face due to Apple's utilization of their materials. A significant point of contention was Apple's opaque strategy regarding the integration of AI into the news sector, given Apple's considerable
user base for news on its platforms. This lack of clarity there was seen as a potential competitive hazard. But despite those concerns, according to the Times, a sense of optimism remained among some executives about the possibility of a collaboration with Apple. They noted Apple's proactive approach in seeking permissions was a stark contrast to the practices of some other AI-driven companies. The other AI outlets have, in their opinion, been training their generative AI models on their
content without consent for a while now. The Times says Apple's leadership has engaged in internal debates for years now about gathering data for developing generative AI products. Apple has tons of data on its users, or it could have, but it doesn't want to make use of that. Apple's cautious stance on data collection, particularly from the internet, is long standing as well. Take the example of Apple's acquisition of Topsy, a social analytics firm in 2013.
Following the acquisition, Apple instructed Topsy to halt its data aggregation from Twitter. This directive was in line with Apple's policy against collecting data that could potentially include information from Apple customers who also use social media platforms like Twitter. The start-up has discussed raising between $8 billion and $10 billion from G42, and that includes possibly raising between $8 billion from Abu Dhabi-based G42 for a chip venture.
So it looks like Sam Altman's grand ambitions are back in play. The start-up has discussed raising between $8 billion and $10 billion from G42. It's unclear whether the chip's venture and wider company funding efforts are related. Open AI Chief Executive Officer Sam Altman had been seeking capital for the chip-making project
codenamed Tigris. The goal is to produce semiconductors that can compete with those from NVIDIA, which currently dominates the AI chip market Bloomberg News reported last month. In October, G42 announced a partnership with Open AI, quote, to deliver cutting-edge AI solutions to the UAE and regional markets, end quote. No financial details were provided. The firm founded in 2018 is led by Sheikh Tanun Bin Zayed Al-Nayan, the UAE's National Security
Advisor, and Chair of the Abu Dhabi Investment Authority. Open AI is set to complete a separate tender offer in early January, which would allow employees to sell their shares at a valuation of $86 billion Bloomberg previously reported. That is being led by Thrive Capital and saw more demand from investors than there was availability, people familiar with the matter have said. If you work in security or IT and your company has Aqda, listen up. This message is for you.
Have you noticed that for the past few years, the majority of data breaches and hacks that you read about have something in common? It's employees. I mean, you hear this in almost every single hacking breach story I do on this show on a daily basis. Hackers absolutely love explaining vulnerable employee devices and credentials. But it doesn't have to be this way. Imagine a world where only secure devices can access your cloud apps. In this world, fish credentials are useless
to hackers and you can manage every OS, even Linux, from a single dashboard. Best of all, you can get employees to fix their own device security issues without creating more work for IT. The good news is you don't have to imagine this world. You can start living in it using Collide. Collide is a device trust solution for companies with Aqda and it ensures that if a device isn't trusted and secure, it can't log into your cloud apps. Visit collide.com slash ride
to watch a demo and see how it works. That's k-o-l-i-d-e.com slash ride. If you're like me, you already know how amazing Notion is, the sponsor of today's episode. I ran the entire AI Resume Project development on Notion. Notion combines your notes, docs, and projects all together in one beautiful space. And navigating that space is easier than ever
thanks to Notion's new feature, Q&A. An AI assistant that can answer questions about Next Quarter's roadmap, find that marketing campaign proposal you're looking for, or dig up a long-loss link all in seconds. Notion AI can now give you instant answers to your questions using information from across your Wiki projects, docs, and meeting notes. Have an urgent question you'd normally turn to a coworker to answer. Just ask Q&A instead.
It'll search through thousands of documents in seconds and answer your question in clear language no matter how large or complex your workspace is. You can also ask Q&A questions from anywhere in Notion so you can find exactly what you need without leaving the doc you're in right now and stay focused on what's important. Try Notion AI for free. When you go to Notion.com slash ride, that's all lowercase letters. Notion.com slash ride
to try the powerful easy to use Notion AI today. And when you use our link, you're supporting our show Notion.com slash ride. I've asked this before and I'll ask it again. Why do hackers love going after game studios? Ubisoft is investigating reports of a new security breach after security research collective VX underground shared screenshots of the company's internal tools.
Going bleeping computer. As part of this alleged breach, the threat actor claimed they gained access to the Ubisoft SharePoint server, Microsoft Teams, Confluence, and MongoDB Atlas panel sharing screenshots of their access to some of these services. MongoDB Atlas recently disclosed a breach but based on their disclosure, it does not appear that this incident is related. These threat actors told VX underground that they attempted to steal data from rainbow six siege
users but were detected and lost access before they could do so. Ubisoft was previously breached by the a Gregor ransomware gang in 2020 who released portions of the Ubisoft Watch Dogs Games source code. The company suffered a second breach in 2022 that disrupted its game systems and services end quote. Seriously, is this a situation of as the old saying goes, you rob a bank because that's where the money is. Do gaming studios tend to pay ransoms maybe or is it that gaming
studios have weirdly bad operational security? Because here's another one. GTA 5 source code appears to have been leaked on Discord, Telegram, a dark website, and others a little over a year after hackers breach rockstar bleeping computer again. Links to download the source code were shared on numerous channels including Discord, a dark website, and a telegram channel that the hackers
previously used to leak stolen rockstar data. In a post to a Grand Theft Auto leak channel on Telegram, the channel owner known as Phil posted links to the stolen source code sharing a screenshot of one of the folders. The channel owner also paid homage to lapsis hacker Arian Kurtaj who previously leaked pre-release videos of Grand Theft Auto 6 under the name Tee Pot Tuber Hacker. Kurtaj was recently sentenced to an indefinite hospital stay by a UK judge for hacking into rockstar and uber.
Hashtag free Arian Kurtaj, he started all of this and insured the leak would become public. I have immense respect for him, miss you buddy end quote, said the Discord channel owner Phil. What was the biggest mobile gaming app of 2023 Royal Match which dethroned long time app store king candy crash from the top of the app store Royal Match held the top spot for the biggest mobile game by monthly revenue globally since July quoting the financial times launched in 2021.
Royal Match is the debut title from Dream Games, a Turkish startup valued at $2.75 billion early last year. For more than a decade, King's Candy Crush saga has been one of the world's most consistently popular games on any platform hitting $20 billion in cumulative revenue this year. Now part of Microsoft after its $75 billion buyout of Activision Blizzard, Candy Crush has spent only six months outside the top 10 highest revenue mobile games since it was released in late 2012
according to data AI. Consumer spending on Royal Match more than doubled in the year to October increasing the game's annual gross revenue run rate before paying out app store fees to $2 billion said sonar i Demir Dream Games co-founder and chief executive Royal Match is a match three puzzle game which would typically involve lining up tiles or icons to clear a grid. These have become the most popular casual gaming genres since they were popularized by bejeweled in the early 2000s.
While it spawned many imitators, Candy Crush saga came to dominate the match three market ranking number one by consumer spend on mobile app stores for nearly 127 consecutive months according to data AI end quote. Royal Match has achieved remarkable player retention apparently with over 90%
of its users continuing into their second year of gameplay. It's widespread appeal stems from it's simple yet engaging puzzle mechanics and an inviting storyline distinguishing it from the typical fantasy battle or casino style games that often lead in revenue on mobile. The game boasts around 55 million monthly active users and has managed to generate higher average spending from its players compared to Candy Crush which has a larger base of about
160 million users as reported by data AI. Dream games are optimistic about maintaining their momentum unlike rivals such as playwrights's gardenscapes and homescapes in 2020. These competitors briefly surpass Candy Crush and sales only to fade back down again. Looking forward, Dream Games is preparing to build on its success by launching a new game, Royal Kingdom, next year aiming to solidify its position in the mobile gaming market.
Finally today, President Biden declined to veto that US ITC decision to ban Apple Watch Series 9 and Ultra 2 imports over a patent dispute. But what I was curious about is what this patent dispute is even all about. Turns out this is a dramatic demonstration of the collision of different IP regimes when tech companies move into new markets. Markets like healthcare, Massimo is a medical technology company basically a lot of those patient monitoring devices and
sensors you see pinging in the background in hospital rooms. They make those. They have a market cap of $6.24 billion. Quoting the Financial Times. Massimo claimed Apple breached two of its patents on pulse oximetry, a technology for monitoring the oxygen level in blood. In the early days of smartphones, the convergence of mobile communications and computing produced a barrage of lawsuits between computing companies such as Apple and Google on the one hand and mobile technology companies
including Nokia and Motorola on the other. Much the same is now happening on a broader front as mobile computing invades markets including healthcare where medical device companies have their own IP modes. Massimo has suffered setbacks in its campaign against Apple and other venues including a case in federal court that resulted in a hung jury this year. But it had better luck before the International Trade Commission a body set up more than a century ago to manage US tariffs.
The ITC has since morphed into a forum for deciding whether imports pose an unfair threat to domestic industry, a quaint sounding anachronism in an age of multinational companies and global supply chains. The ITC has become a favorite venue for plaintiffs such as Massimo. Since a landmark 2006 patent case involving eBay, it has been far harder to persuade a federal court to grant
an injunction barring the sale of products found to infringe on patent rights. By contrast, the ITC's only sanction is to issue exclusion orders that direct customs officers to block imports at the border. Analysts argue that the commission could wield this cudgel in less damaging ways. Others have proposed reforms including strengthening the White House's ability to veto ITC
bands when a valid public interest is at stake. Large companies still have plenty of other weapons at their disposal as a parallel case involving a different medical sensor on the Apple Watch shows. The ITC last year issued another import ban against the device after a complaint from medical equipment maker AliveCore, the case involved electrocardiogram technology which measures electrical signals from the heart. That ban was put on hold after Apple challenged
AliveCore's patents before a body known as the patent trial and appeal board. This was set up by the 2011 America Invents Act, the last major reform of the U.S. patent system to make it easier to challenge the validity of patents and tip the bounce away from so-called patent trolls accused of abusing the system. The mechanism here is that since Apple has to import every device it sells from its overseas manufacturing, even though the patent issue is still outstanding,
that's why they simply can't sell the watch right now. Quick, possibly dumb question. Why didn't Apple just buy Massimo? I mean, $6 billion dollar market cap? Apple can afford that. And they probably don't want to run a medical device company, though they could probably learn a lot from them if they do as we assume want to get more into health, right? But also, if that's Massimo's market cap, could the license Massimo had been asking for for the patents have been that insane?
Again, Apple could have afforded possibly avoiding all of this Mass? So it turns out if you long press on share or repost on threads, you can quickly quote a post or access the native share sheet. Just kidding. But if you were on threads at all, and I mean at all, this past weekend you'll get the joke. Talk to you tomorrow.