Fri. 04/19 – All The News About Llama 3 - podcast episode cover

Fri. 04/19 – All The News About Llama 3

Apr 19, 202417 min
--:--
--:--
Listen in podcast apps:

Episode description

Meta released Llama 3 yesterday, and some of the moves they made have made be consider if Zuck could win these first AI wars. Is Zuck also getting aggressive in VR? Why Apple had to take down the WhatsApp and Threads apps in China. And, of course, the weekend longreads suggestions.

Links:


Weekend Longreads Suggestions:

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Transcript

Welcome to the Techmeme Ride Home for Friday, April 19, 2024, I'm Brian McCullough today. Met a release, Llama 3 yesterday, and some of the moves they made have made me consider if Zuck could win these first AI wars. Is Zuck also getting aggressive in VR? Why Apple had to take down the WhatsApp and Threads apps in China? And of course, the weekend long rate suggestions. Here's what you missed today in the world of tech.

Big AI news for Met a yesterday, but I'm going to break it up a bit. First, Met a detailed its new flagship open source AI model Llama 3 comes in 8 billion and 70 billion parameter models to different flavors. And those are available now. They are also right now powering the Met a AI chatbot, but also interesting, they teased an upcoming model trained on 15

trillion tokens with more than 400 billion parameters. Llama 2 was trained on 2 trillion tokens, so the leap to 15 trillion is quite something. Quoting the verge. A key focus for Llama 3 was meaningfully decreasing its false refusals or the number of times a model says it can't answer a prompt that is actually harmless. An example Zuckerberg offers is asking it to make a killer margarita. Another is one I gave him during an interview last year when the earliest version of Met a AI wouldn't

tell me how to break up with someone. Met a has yet to make the final call on whether to open source the 400 billion parameter version of Llama 3 since it's still being trained. Zuckerberg downplays the possibility of it not being open source for safety reasons. Quote, I don't think that anything at the level of what we are others in the field are working on in the next year is really in the ballpark of those type of risks. So I believe that we will be able to open source it and quote.

Before the most advanced version of Llama 3 comes out, Zuckerberg says to expect more iterative updates to the smaller models like longer context windows and more multi-modality. He's coy on exactly how that multi-modality will work though it sounds like generating video akin to open AI Sora isn't in the cards yet. Met a once it's assistant to become more personalized and that could mean eventually being able to generate images in your own likeness and quote.

Now we mentioned that Llama 3 is powering the meta AI chatbot and meta is bringing that to Instagram to WhatsApp to messenger to Facebook in more than 12 countries and when I say bringing it to them, I mean it will be right there in the search bar in those apps. It'll be right there in the main Facebook feed quoting the New York Times. The AI software will become practically omnipresent inside the news feed in search bars and in chats with friends.

People will be able to ask the assistant meta AI for help in completing tasks and getting information such as what concerts might be occurring in San Francisco on a Saturday night or the best options for vegan enchiladas in New York and quote. And if you want to see something right now that will allow you go to a.net.com ask it to draw a picture draw a picture of a beagle. A beagle writing a motorcycle wearing goggles in the style of a 1950s black and white movie.

As you are typing those words step by step auto complete style the picture changes almost instantly to conform to your prompts. If you go back in your sentence and change beagle to giraffe the picture changes instantly to. If you're familiar with other image generating models that can take half a minute or more every time you prompt it to do an image, you'll be wowed by the wizardry involved here.

Okay, so on that last bit the bit about meta incorporating llama directly into their family of apps lots of people like who cares what is the use of having an AI bot inside of say Instagram. Well, whisper it quietly, but I think this move is bold enough to suggest that Mark Zuckerberg is maybe the best position to win this first round of the AI wars. Why?

Well, originally I said that meta was in a good place because they had access to a ton of data to train on that others don't open AI can scan the web can scrape YouTube videos Google can do this to so can others, but they cannot train their models on Instagram or 20 years of Facebook post Zuckerberg can. But also the bigger advantage Zuck has here is distribution. Remember, meta's family of apps has three billion users open AI has what 100 million users of chat GPT.

I'm going to invoke the will my mother use this rubric here is my mother or hundreds of millions of other normies likely to sign up for a chat GPT account or a Mral account or anything like that to begin testing if AI is useful in their lives. Not yet, but what they will do is they will try AI out if it's right there in front of them in their Facebook app. How did Zuck win over Snapchat?

How is he battling TikTok sometimes by creating standalone apps, but mostly just by turning on stories and reels and all the other copycat features inside of the apps the people already use. It's a powerful lever. Not everybody was going to sign up for an Instagram account, but he got a lot of people to use stories on Facebook anyway because it just showed up.

How many millions of people could potentially be educated about using AI and maybe becoming habituated to it inside a meta app they already use. If my mom can plan her next vacation inside of Instagram, well then what does she need to try out some other new company if it just does largely the same thing. All of these companies integrating AI and chat bots into Excel into email clients and enterprise clients. The idea is just to make AI a part of the computing you already do.

Not some new company or startup or new compute paradigm. There's been a lot of talk about how the big tech incumbents seem to be the early winners of the AI race with meta. Can you see the angle of how this could be that on steroids? Let's just take one narrow use case. For years, Zuck has dreamed of people doing their search inside an app like Facebook instead of Google. That search, you still need the open web.

As we've discussed with startups like the ARC browser, there's a new kind of search now with AI where you don't need the open web at all. Well the bots do, but you don't because you never see it. It's all summarized for you. The web itself is abstracted away. Don't you think it's Mark Zuckerberg's fever dream to have the web abstracted away? For a lot of people, the internet is their experience on Facebook, on Instagram, on WhatsApp.

Now imagine they never have to leave a Zuckerberg production basically ever. A day when, after getting used to doing search and stuff via his AI, you have your meta AI assistant. Do your shopping for you. Zuck doesn't need to make money on this AI stuff right now or for a very long time. If AI takes off inside his apps and people start spending more time inside his apps and not elsewhere, even incrementally, at the scale of 3 billion people, he wins big time eventually.

And with the whole metaverse experiment, he's proven a willingness to burn billions of dollars playing the long game. Open AI and the startups need to either hope their API calls, power the AI revolution in the background or that they can get especially enterprises to sign up for subscription products. Google needs to hope they can train people to search using their AI in such a way as to not kill.

So if you search overnight, Microsoft is sort of like meta in the sense that they hope AI happens inside of apps people already use and can just charge them extra money for that. Apple hopes you can do AI stuff on device to the degree that that is top of the funnel stuff for AI usage. But what if meta and Zuckerberg suddenly have the leverage over the major hardware platforms that he's always dreamed of because of their scale?

Forget Asian style super apps where you live your whole life inside the app. If Facebook or Instagram or Messenger powered by AI allow you to do everything you'd want to do on the web or on your phone inside of that app, then the hardware doesn't matter. The web doesn't matter. All that would matter would be Zuck's apps as the delivery method for that AI future. Speaking of Zuck in his long game, what do you think he's seen in the sales numbers of the Apple Vision Pro that prompted this?

And I mean that either way, either the Vision Pro is selling more than he thought or selling less. But meta has cut the price of the base 128GB Quest 2 VR headset from $250 to $199. The second permanent price cut in just four months after a drop from $299 to $249 in January. Go to Engagit. Of course, the price cut comes in the wake of the company rolling out the far more powerful and capable meta Quest 3, which starts at a far higher price of $499.

The discount suggests that meta is trying to get rid of its remaining inventory of the previous model still. The Quest 2 is our pick for the best cheap VR headset and the drop to $199 makes the device even more appealing. For a couple hundred bucks, you'll get a headset that has fast switching LCD displays with a resolution of 1832 by 1920 per eye and a 90 Hertz refresh rate. It has a solid library of VR apps at this point, along with access to cloud gaming services like Xbox Cloud Gaming.

However, you slice it. The Quest 2 is a solid entry point into VR. In addition, meta recently lowered the prices of Quest 2 accessories. One more new AI model here real quick. Microsoft researchers have introduced Vasa 1, an AI model that creates a realistic, talking head video from a portrait photo and an audio file. This has been released into research preview only, quoting Tom's guide.

Vasa 1 takes a single portrait photo and an audio file and converts it into a hyper-realistic talking face video complete with lip sync, realistic facial features, and head movement. The model is currently only a research preview and not available to anyone outside of the Microsoft research team to try, but the demo videos look impressive.

Another lip sync and head movement technology is already available from runway and Nvidia, but this seems to be of a much higher quality and realism reducing mouth artifacts. This approach to audio driven animation is also similar to a recent vlogger AI model from Google Research. Microsoft says this is a new framework for the creation of life-like talking faces and specifically for the purpose of animating virtual characters.

All of the people in the examples were synthetic made using Dolly, but if it can animate a realistic AI image, it can animate a real photo. In the demo, we see people talking as if they were being filmed with slightly jerky, but otherwise natural looking movement. The lip sync is very impressive with natural movement and no artifacts around the top and bottom of the mouth seen in other tools.

One of the most impressive things about Vasa 1 seems to be the fact that it doesn't require a face forward portrait style image to make it work. Now lots of people are rightfully concerned about the negative implications of this. Thankfully so, as I say, because just one photo and you could have absolutely anybody saying anything. That's why Microsoft is keeping this for researchers only at this point. But think of the lowly podcaster.

If I could upload a photo of myself and the audio of the show each day, I could create a TikTok video of every segment of this show every day. You imagine I would want to do that. Guys tend to think looking sharp means starchy oxfords and stiff chinos rather than effortless comfort. But it's possible to have it both ways. Mac Weldon makes timeless apparel with modern performance fabrics for guys who want to look and feel sharp without sacrificing comfort.

Mac Weldon clothes are designed to fit your style and the demands of modern life. This warm out today, so I'm wearing one of the pillows I got from Mac Weldon when I stocked up for the spring. I could wear this to my son's soccer practice, but I'm also wearing it to an investor meet-up in the city tonight. That's because Mac Weldon apparel looks like regular clothes, but feels like the latest in modern comfort. They're the go-to choice for guys who want to look great without even trying.

This polo I'm wearing is an upgrade on the classic polo with antimicrobial silver threads. It feels great from their light as air underwear to innovative anti-odor teas and versatile yet comfortable pants. Mac Weldon has a full range of clothes that never go out of style. Get timeless looks with modern comfort from Mac Weldon. Go to Mac Weldon.com and get 20% off your first order with promo code ride. That's m-a-c-w-e-l-d-o-n.com promo code ride. 10 seconds on the clock.

How many things can you name that are always growing? How about your customer base? How about your business on Shopify? Shopify is the global commerce platform that helps you sell at every stage of your business. From the Launcher online shop stage to the first real-life store stage all the way to the did we just hit a million orders stage. Shopify is there to help you grow whether you're selling scented soap or offering outdoor outfits.

Shopify helps you sell everywhere from their all-in-one e-commerce platform to their in-person POS system. Wherever and whatever you're selling, Shopify's got you covered. Shopify helps you turn browsers into buyers with the internet's best converting checkout. 36% better on average compared to other leading commerce platforms. And sell more with less effort thanks to Shopify Magic, your AI powered all-star.

Was just checking in on our Shopify store this morning running flawlessly as it's done for nearly a decade now. Shopify powers 10% of all e-commerce in the US and Shopify's the global force behind all birds, Rothies, and Brooklyn and millions of other entrepreneurs of every size across 175 countries. For a $1 per month trial period at Shopify.com slash ride, all lowercase go to Shopify.com slash ride now to grow your business no matter what stage you're in. Shopify.com slash ride.

And real quick, Apple has removed WhatsApp and threads from its App Store in China saying it was ordered to do so by China's cyberspace officials, citing national security concerns, quoting the journal. The cyberspace administration of China asked Apple to remove WhatsApp and threads from the App Store because both contain political content that includes problematic mentions of the Chinese president according to a person familiar with the matter.

And Apple spokesperson said that wasn't part of the reasoning. The move shrinks the number of foreign chat apps Chinese internet users can use to communicate with those outside of the country, a further tightening of internet controls by Beijing, which is sensitive to uncensored information circulating. Act tensions between the US and China are already running high.

Congress is fast tracking a bipartisan effort to crack down on TikTok that could lead to passage of a law this month, forcing its Chinese parent to sell the popular video sharing app in the US or face a ban.

Collectively, Instagram, X, Facebook, YouTube and WhatsApp have been downloaded from Apple's App Store more than 170 million times in China over the past decade, according to estimates by market research firm sensor tower apps such as X were key to disseminating information and videos of protests against COVID rules in China that erupted in late 2022. Time for the weekend long read suggestions. First up, I could not recommend this piece from the New Yorker highly enough.

It's called How Perfectly Can Reality Be Simulated? It has everything. Basically, the history of video games graphics, the history of game engines, the history of VFX filmmaking techniques and Hollywood, thrown in for good measure, a history of Epic games and Tim Swini, and even right at the top, how designers captured digital assets from the real world to put into games and graphics. Do they go out like Google does for Google Maps, into the world and scan and photograph everything?

You have better believe it. One of the best articles I've read in ages. Conversely, this long piece from Harper's makes the provocative case that Hollywood itself, as we know it, as an industry might be on the cusp of an extinction level event. Quote, The film and TV industry is now controlled by only four major companies and it is shot through with incentives to devalue the actual production of film and television. What is to be done? The most direct solution would be government intervention.

If it wanted to a presidential administration could enforce existing antitrust law, break up the conglomerates and begin to pull entertainment companies loose from asset management firms, it could regulate the use of financial tools. As Deward has suggested, it could rein in private equity. The government could also increase competition directly by funding more public film and television. It could establish a universal basic income for artists and writers. None of this is likely to happen.

And finally from the Guardian, a history of Neopets. Combined with the news that Neopets is apparently having a resurgence. Quote, Neopets was launched in 1999 as an early internet universe where users could care for a variety of virtual pets and play mini games. A crude social network that predated Facebook, the site allowed users to add friends, message one another, trade resources or virtual currency and battle.

It peaked at more than 25 million active users in the mid-2000s before seeing a steep decline in popularity as competing gaming and social sites exploded across the internet. The platform has changed hands a number of times since its inception and amid the acquisitions, it languished, reporting just 100,000 users when it was purchased by the Chinese firm NetDragon 2017.

Deepening its decay was the decline of Adobe's flash player, the software used to power much of the site, which browsers began to phase out around 2017 before the company officially killed it off in 2020. Neopets fell by the wayside, receiving little attention or updates to its interface.

That was until the entrepreneur and investing consultant Dominic Law, who joined NetDragon in 2020 as director of new markets, launched an internal campaign to revive the Neopets brand, which he called a major leap of faith. You're going to hear an interview I did soon with a major figure in the tech industry who said Neopets was their entree into computing and even programming. No bonus episodes for you this weekend, but I've got something exciting to roll out next week.

Something I've been working on from the beginning of the year can't wait to tell you about it. On Monday.

This transcript was generated by Metacast using AI and may contain inaccuracies. Learn more about transcripts.