Thu. 06/20 - Ilya Sutskever’s New AI Startup - podcast episode cover

Thu. 06/20 - Ilya Sutskever’s New AI Startup

Jun 20, 202417 min
--:--
--:--
Listen in podcast apps:

Episode description

Ilya Sutskever wants to go straight to Safe Superintelligence, do not pass go, but do probably collect hundreds of millions of dollars. Is Perplexity ignoring robots.txt files? Xreal’s hybrid AR glasses play. And how many apps did Apple sherlock at WWDC last week?


Links:

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Transcript

Welcome to the Techmeme Ride Home for Thursday June 20th, 2024. I'm Brian McCullough today. Ilya Sutskever wants to go straight to safe super intelligence, do not pass go, but do probably collect hundreds of millions of dollars. He is perplexity ignoring robots.textfiles, X-Reels hybrid AR glasses play, and how many apps did Apple Sherlock at WWDC last week? Here's a gemis today in the world of tech.

Well, we now know what Ilya Sutskever's next act will be, now that he's left open AI. Along with Daniel Gross and Daniel Levy, he is founding Safe Super Intelligence, a new AI startup quote with one goal and one product, a Safe Super Intelligence. Gross is the former AI-leaded Apple and is Nat Friedman's frequent investing partner if you remember from that bonus episode with Nat Levy, worked alongside Sutskever at OpenAI, quoting from Bloomberg.

This company is special in that its first product will be the Safe Super Intelligence and it will not do anything else up until then. Sutskever says in an exclusive interview about his plans, it will be fully insulated from the outside pressures of having to deal with a large and complicated product and having to be stuck in a competitive rat race.

Sutskever declines to name Safe Super Intelligence's financial backers or disclose how much he's raised, as the company's name emphasizes Sutskever has made AI safety the top priority.

The trick, of course, is identifying what exactly makes one AI system safer than another or really safe at all. Sutskever is vague about this at the moment though he does suggest that the new venture will try to achieve safety with engineering breakthroughs baked into the AI system, as opposed to relying on guardrails. By Safe, we mean Safe like nuclear safety, as opposed to Safe as in Trust and Safety, he says.

I think the time is right to have such a project, says Levy. My vision is exactly the same as Ilias, a small lean cracked team with everyone focused on the single objective of a Safe Super Intelligence. Safe Super Intelligence will have offices in Palo Alto, California and Tel Aviv, both Sutskever and Gross grew up in Israel.

Given Sutskever's near mythical place within the AI industry, the uncertainty around his status has been a Silicon Valley fixation for months. As a university researcher and later a scientist at Google, he played a major role in developing a number of key AI advances.

His involvement in the early days of OpenAI helped it attract the top talent that's been essential to its success. Sutskever became known as its major advocate for building ever larger models, a strategy that helped the startup search pass Google and proved crucial to the rise of chat GPT.

Safe Super Intelligence is in some ways a throwback to the original OpenAI concept, a research organization trying to build an artificial general intelligence that could equal and perhaps surpass humans on many tasks. But OpenAI structure evolved as the need to raise vast sums of money for computing power became evident. This led to the company's tight partnership with Microsoft and contributed to its push to make revenue generating products.

All of the major AI players face a version of the same conundrum needing to pay forever expanding computational demands as AI models continue to grow in size at exponential rates. These economic realities make Safe Super Intelligence a gamble for investors who would be betting that Sutskever and his team will hit on breakthroughs to give it an edge over rivals with larger teams and significant head starts.

Those investors will be putting down money without the hope of creating profitable hit products along the way, and it's not at all clear that what Safe Super Intelligence hopes to make is even possible. With Super Intelligence, the company is using AI industry lingo to refer to a system that would be in another league than the human level AI's most of the larger tech players are pursuing.

There's no consensus in the industry about whether such an intelligence is achievable or how a company would go about building one. That said, Safe Super Intelligence will likely have little trouble raising money given the pedigree of its founding team and the intense interest in the field. Out of all the problems we face, raising capital is not going to be one of them, says Gross.

Researchers and intellectuals have contemplated making AI systems safer for decades but deep engineering around these problems has been in short supply. The current state of the art is to use both humans and AI to steer the software in a direction aligned with humanity's best interests. Exactly how one would stop an AI system from running a muck remains a largely philosophical exercise.

Sutskever says that he's spent years contemplating the safety problems and that he already has a few approaches in mind. But Safe Super Intelligence isn't yet discussing specifics. The different intelligence should have the property that it will not harm humanity at a large scale. Sutskever says, after this we can say we would like it to be a force for good. We would like to be operating on top of some key values.

Some of the values we were thinking about are maybe the values that have been so successful in the past few hundred years that underpin liberal democracies like Liberty Democracy Freedom. Sutskever says that the large language models that have dominated AI will play an important role within Safe Super Intelligence but that it's aiming for something far more powerful. With current systems he says, you talk to it, you have a conversation and you're done.

The system he wants to pursue would be more general purpose and expansive in its abilities. You're talking about a giant super data center that's autonomously developing technology. That's crazy right? It's the safety of that that we want to contribute to. Meanwhile, Forbes continues to threaten AI search company perplexity with legal action for allegedly plagiarizing its content.

A new analysis alleges that perplexity also seems to be scraping sites using surreptitious methods ignoring robots.text files with a perplexity tied machine doing so on wired and other sites.

According from wired itself, a wired analysis and one carried out by developer Rob Knight suggests that perplexity is able to achieve this partly through apparently ignoring a widely accepted web standard known as the robot's exclusion protocol to surreptitiously scrape areas of websites that operators do not want access by bots despite claiming that it won't wired observed a machine tied to perplexity more specifically one on an Amazon server and almost certainly operated by perplexity doing this on wired.com and across other conda nass publications.

Wired provided the perplexity chatbot with the headlines of dozens of articles published on our website this year as well as prompts about the subjects of wired reporting. The results showed the chatbot at times closely paraphrasing wired stories and at times summarizing stories inaccurately and with minimal attribution. In one case, the text it generated falsely claimed that Wired had reported that a specific police officer in California had committed a crime.

The AP similarly identified an instance of the chatbot attributing fake quotes to real people. Despite its apparent access to original wired reporting and its site hosting original wired art, though none of the IP addresses publicly listed by the company left any identifiable trace in our server logs raising the question of how exactly perplexity system works.

Until earlier this week perplexity published in its documentation a link to a list of the IP addresses its crawlers use in apparent effort to be transparent. However, in some cases as both wired and night were able to demonstrate it appears to be accessing and scraping websites from which coders have attempted to block its crawler called perplexity bot using at least one unpublished IP address. The company has since removed references to its public IP pool from its documentation.

That secret IP address 44.221.181.252 has hit properties at Kandai NAS, the media company that owns Wired, at least 822 times in the past three months. One senior engineer at Kandai NAS who asked not to be named because he wants to, quote, stay out of it, calls this a, quote, massive undercount because the company only retains a fraction of its network logs.

Wired verified that the IP address in question is almost certainly linked to perplexity by creating a new website and monitoring its server logs. Immediately after a Wired reporter prompted the perplexity chatbot to summarize the website's content, the server logged that the IP address visited the site. This same IP address was first observed by night during a similar test.

It also appears probable that in some cases and despite a graphical representation in its user interface that shows the chatbot reading specific source material before giving a reply to a prompt, perplexity is summarizing not actual news articles but reconstructions of what they say based on URLs and traces of them left in search engines like extracts and metadata offering summaries, purporting to be based on direct access to the relevant text.

The magic trick that's made perplexity worth 10 figures in other words appears to be that it's both doing what it says it isn't and not doing what it says it is, end quote. An angle I hadn't thought of with regards to Apple intelligence is think about what's a big important market for Apple China.

What doesn't operate in China open AI so sources are telling the journal that Apple has held talks with Baidu Ali Baba, Baichuan AI and others to help offer Apple intelligence in China quote in China Apple is falling behind local rivals that have already incorporated AI functions into their phones.

The iPhone dropped to third place by handset market share among smartphone brands in China in the first quarter of this year behind two local brands according to counterpoint research. Apple has held talks with several Chinese companies that make AI models including search engine company Baidu e-commerce leader Ali Baba Group and a Beijing based startup called Bachuan AI people familiar with the matter said.

In China companies must seek Beijing's approval before introducing AI chat bots built on large language models trained with huge databases of text images and video vacuumed up from the internet and other sources. Regulators vet the models to ensure they don't influence public opinion in a way the government doesn't approve of as of March Beijing's internet watchdog the cyberspace administration of China had approved 117 generative AI products none of which is foreign developed.

Early this year Apple explored the possibility of obtaining approval for a foreign large language model to be used in its devices in China but it found that Chinese regulators were unlikely to approve it people familiar with the matter said that realization prompted Apple to step up talks with potential local partners they said Apple said the region that includes mainland China Taiwan Hong Kong and Macau accounted for 18% of its global revenue in the quarter ended March 30.

Its position is threatened by local companies this year Huawei is expected to account for 17% of China smartphone market up from 13% last year while Apple share is projected to drop to 16% from 18% according to counterpoint end quote. This message is sponsored by Greenlight as your kids get old or some things about parenting get easier you know they can dress themselves lug their own suitcases through the airport.

But other things don't get easier like having that conversation with your kids about money the fact is kids won't really know how to manage their money until they're actually in charge of it.

That's where Greenlight can help Greenlight is a debit card and money app made for families parents can send money to their kids and keep an eye on kids spending and saving while kids and teens build money confidence and lifelong financial literacy skills with the Greenlight app kids learn how to save invest and spend wisely thanks to games that teach money skills in a fun accessible way.

The Greenlight app also includes a chores feature where you can set up one time or recurring chores customized to your family's needs and reward kids with allowance for a job well done. It's a far cry from me getting my allowance in quarters for every time I emptied the dishwasher millions of parents and kids are learning about money on green light it's the easy convenient way for parents to raise financially smart kids and families to navigate life together.

Sign up for Greenlight today and get your first month free when you go to greenlight.com slash ride that's greenlight.com slash ride to try green light for free green light.com slash ride. If you're a marketer you probably got into marketing because you like being creative if you're a developer it's because you like building cool stuff but too often marketers and developers are stuck with old school content management systems that make it harder to do that.

Storyblock a content management system is here to help teams from Netflix Tesla and Oatley are among the 200,000 story block users who switched from old school systems like site core Drupal and AEM2 story block. Why? Storyblock makes it easier for marketers and developers to build websites apps and other digital experiences and simply get shit done.

For example, Storyblock has a new feature called the ideation room. The ideation room is a central space within Storyblock where you can collaborate with your teammates to come up with new ideas and refine them with the help of AI. If you want to ship your work in less time and stop wrestling with your CMS try Storyblock for free today at get.storyblock.com slash ride home. That's get dot STORYBLOK dot com slash ride home.

X-Reel has unveiled the $199 beam pro a 6.5 inch device that powers X-Reel's glasses runs Android 14 based Nebula OS uses a snapdragon chip and has two USB C ports to the better to charge while you're also connected to the AR glasses. It's a handheld device with the rough dimensions of a smartphone but X-Reel thinks of it more as a companion to your glasses. On the back there's a dual lens camera you can use to take spatial and 3D videos for viewing in your glasses or your vision pro.

X-Reel says the beam pro's footage will work in your Apple headset too. When you have your glasses plugged in you can use the beams screen as a touchpad and the device is also designed to have two apps open side by side in your field of view. When you first plug in the glasses it'll pop up a home screen of your apps which you can open and control using the beam pro as a remote. The beam pro looks like a big upgrade on the beam which was essentially just a remote control for your X-Reel glasses.

The beam definitely solved the problem for X-Reel owners but it had some issues. A bunch of reviewers and users found it was fiddly and unreliable and X-Reel had a hard time explaining to users why it even existed in the first place. The screen should make the pro much easier to use and the camera makes it more than just a lesser smartphone replacement.

You can of course still plug in your steam deck or a smartphone and use X-Reel's glasses that way but this feels like a more integrated approach. X-Reel's approach is much less integrated than what we're seeing from Apple and Meta both of which are determined to put a whole computer on your face. But there's something clever about X-Reel's way. It's using a totally mature device category to do all the hard work and doing as little on your face as possible.

At least for now, it feels like a smart strategy. Finally today, stories like this one have been floating around since last week so let me catch this one as representative of them all. According to AppFigures, iOS 18 could Sherlock apps that have an estimated $393 million in annual revenue. According TechCrunch, Apple's practice of leveraging ideas from its third party developer community to become new iOS and Mac features and apps has a hefty price tag.

A new report indicates with the release of iOS 18 later this fall, Apple changes may affect apps that today have an estimated $393 million in revenue and have been downloaded roughly 58 million times over the past year according to an analysis by App Intelligence firm AppFigures. Every June at Apple's Worldwide Developers Conference, the iPhone Maker teases the upcoming releases of its software and operating systems which often include features previously only available through third party apps.

The practice is so common now it's even been given a name. Sherlocking, a reference to a 1990s search app for Mac that borrowed features from a third party app known as Watson. Now when Apple launches a new feature that was before the domain of a third party app, it is said to have Sherlocked the app. In earlier years, Sherlocking apps made some sense. After all, did the iPhone's flashlight really need to be a third party offering or would it be better as a built-in function.

Plus Apple has been able to launch features that have made its software better adapted to consumers once and needs by looking at what's popular among the third party developer community. Of course, this practice also raises the question as to whether Apple is leveraging proprietary data to make its determinations about what to build next and whether the apps it competes with are being offered in even playing field.

For example, before Apple launched its own parental control system, it shut down many third party apps that had built businesses in this space by saying their solutions were now non-compliant with its rules and policies. The apps weren't offered access to a developer API for managing Apple's built-in parental controls for years, prompting in antitrust investigation.

In more recent years, Apple has Sherlocked third parties with launches of features like continuity camera, medication tracking, sleep tracking and mood tracking as well as apps like Freeform and Journal. This year, it turned its attention to password managers, call recording and transcription apps, those for making custom emoji, AI-powered writing tools and math helpers, trail apps and more.

In an analysis of third party apps that generated more than a thousand downloads per year, app figures discovered several genres that had found themselves in Apple's Crosshairs in 2024. In terms of worldwide gross revenue, those categories have generated significant income over the past 12 months, with the trail app category making the most at $307 million per year led by market leader and 2023 Apple app of the year, all trails.

Grammar helper apps like Grammarly and others also generated $35.7 million while math helpers and password managers earn $23.4 million and $20.3 million respectively, apps for making custom emoji generated $7 million, too.

These trail apps accounted for the vast majority of potentially Sherlocked revenue or 78% noted app figures as well as 40% of downloads of Sherlocked apps. In May 2024, they accounted for an estimated $28.8 million in gross consumer spending and 2.5 million downloads to give you an idea of scale. Many of these app categories were growing quickly with math solvers having seen revenue growth of 43% year over year followed by grammar helpers, up 40% password managers, up 38% and trail apps up 28%.

Emoji making apps however were seeing declines of negative 17% year over year. Although these apps certainly have dedicated user bases that may not immediately choose to switch to a first party offering, Apple's ability to offer similar functionality built in could be detrimental to their potential growth. Casual users may be satisfied by Apple's good enough solutions and won't seek out alternatives.

There is nothing like international tournaments in the summer, flip-ball on all day long while I work. Come on, England. Talk to you tomorrow.

This transcript was generated by Metacast using AI and may contain inaccuracies. Learn more about transcripts.