Welcome to the Techmeme Ride Home for Wednesday, August 28, 2024. I'm Brian McCullough. Today, I explain why everyone has been posting strawberries and AI circles. It's because of a potential new breakthrough at OpenAI. Siribras launches the first new AI chip competition to Envidia. China has reportedly burrowed into US ISPs and continuing interesting details pouring out of that povled, durav situation. Here's what you missed today in the world of tech.
For months now, in certain AI circles, people have been talking about strawberries. Strawberries and their bios, strawberry emojis, Twitter spaces about strawberries. Some folks thought strawberries indicated the coming of GPT-5, but most of the chatter recently made it seem like it was going to be something along the lines of what is currently being reported by the information. Our source says, OpenAI has demoed a breakthrough called Strawberry to US National Security Officials.
One of its top uses is to make training data for the next flagship LLM from OpenAI codenamed Orion. But there's lots of interesting stuff here. Quote. In case you were wondering why Sam Altman cryptically posted a picture of strawberries earlier this month, the answer almost certainly has to do with Strawberry. A mysterious technical breakthrough that could help OpenAI's models complete complex tasks such as math problems
that conversational AI has traditionally struggled with. If this sounds familiar, it's likely because Strawberry was previously called Q-Star. This summer, the OpenAI team demonstrated the technology to American National Security Officials, set a person with direct knowledge of those meetings which haven't previously been reported. By demonstrating an unreleased technology to government officials, OpenAI could be setting a new standard for AI developers,
especially as advanced AI increasingly becomes a national security concern. The demonstration could be part of OpenAI's push to become more transparent with policymakers who could cause the company problems if they feel threatened by its technology. One of the most important applications of Strawberry is to generate high quality training data for Orion. OpenAI's next flagship LLM model, that's in development. The code name hasn't previously been reported.
Using Strawberry could help Orion reduce the number of hallucinations or errors it produces researchers tell me, that's because OpenAI models learn from their training data, so the more correct examples of complex reasoning, they see the better. But there's also a push within OpenAI to simplify and shrink Strawberry through a process called distillation, so
it can be used in a chat-based product before Orion is released. This shouldn't come as a surprise given the intensifying competition among the top AI developers. So Strawberry sounds like it's what we've been waiting for, a breakthrough in reasoning that will, among other things, allow OpenAI to create Orion, which is essentially GPT-5, but also might be released as an upgrade to chat GPT anytime now. More on what this breakthrough actually entails, according to a different information piece.
Strawberry can solve math problems it hadn't seen before, something today's chatbots cannot reliably do, and also has been trained to solve problems involving programming. But it's not limited to answering technical questions. When given additional time to, quote, think the Strawberry model can also answer customers questions about more subjective topics, such
as product marketing strategies. To demonstrate Strawberry's prowess with language-related tasks, OpenAI employees have shown their co-workers how Strawberry can, for example, solve New York Times connections, a complex word puzzle. OpenAI's prospects rest in part on the eventual launch of a new flagship LLM, it is currently developing codenamed Orion. That model seeks to improve upon its existing flagship LLM GPT-4, which it launched early last year. By
now, other rivals have launched LLMs that perform roughly as well as GPT-4. It isn't clear whether a chatbot version of Strawberry that can boost the performance of GPT-4 and chat GPT will be good enough to launch this year. The chatbot version is a smaller simplified version of the original Strawberry model known as a distillation. It seeks to maintain the same level of performance as a bigger model while being easier and less costly to operate.
However, OpenAI is also using the bigger version of Strawberry to generate data for training Orion, steady person with knowledge of the situation. That kind of AI-generated data is known as synthetic. It means that Strawberry could help OpenAI overcome limitations on obtaining enough high-quality data to train new models from real-world data such as text or images
pulled from the internet. Using Strawberry to generate higher-quality training data could help OpenAI reduce the number of errors its models generate, otherwise known as hallucinations, said Alex Graveli, CEO of Agents Startup, Minion AI, and former Chief Architect of GitHub Co-Pilot. Imagine, quote, a model without hallucinations, a model
where you ask at a logic puzzle and it's right on the first try. Graveli said, the reason why the model is able to do that is because, quote, there is less ambiguity in the training data, so it's guessing less. AI that solves tough math problems could be a potentially lucrative application, given that existing AI isn't great at math heavyfield such as
aerospace and structural engineering. It's a goal that has tripped up AI researchers who have found that conversational AI chat GPT and its ilk is prone to giving wrong answers that would flunk any math student. Improvements in mathematical reasoning could also help AI models reason better about conversational queries such as customer service requests. Strawberry has its roots in research. It was started years ago by Ilya Suskevar, then OpenAI's chief
scientist. He recently left to start a competing AI lab. Before he left, OpenAI researchers Jacob Pechoki and Simon Sidor built on Suskevar's work by developing a new math solving model Q-Star, alarming some researchers focused on AI safety. The breakthrough and safety conflicts at OpenAI came just before OpenAI board directors led by Suskevar fired Sam Altman before
quickly rehiring him. More AI horse race stuff, Cerribris has launched what they are calling the world's fastest AI inference service with quote GPU impossible performance with costs starting at 10 cents per million tokens. This is the first salvo in the race to rival
Nvidia and making better AI specific chips. Ambitious artificial intelligence computing start-ups, Cerribris systems is raising the stakes in its battle against Nvidia, launching what it says is the world's fastest AI inference service and it's available now in the cloud. AI inference refers to the process of running live data through a trained AI model to make
a prediction or solve a task. Infraint services are the workhorse of the AI industry and according to Cerribris, it's the fastest growing segment too, accounting for about 40% of all AI workloads in the cloud today. Cerribris believes this launch is a watershed moment for the AI industry saying that a thousand tokens per second speeds that it can deliver is comparable to the introduction of broadband internet enabling game changing new opportunities for AI applications.
Cerribris is well equipped to offer such a service the company is a producer of specialized and powerful computer chips for AI and high performance computing or HPC workloads. It has made a number of headlines over the past year claiming that its chips are not only more powerful than Nvidia's graphics processing units but also more cost effective. This
is GPU impossible performance declared co-founder and chief technology officer Sean Lai. Its flagship product is the new WSE3 processor which was announced in March and builds upon its earlier WSE2 chipset that debuted in 2021. It's built on an advanced 5 nanometer process and features 1.4 trillion transistors more than its predecessor chip with more
than 900,000 compute cores and 44 gigabytes of onboard static random access memory. According to the startup the WSE3 has 52 times more cores than a single Nvidia H100 graphics processing unit. The chip is available as part of a data center appliance called the CS3 which is about the same size as a small refrigerator. The chip itself is about the same size as a pizza and comes with integrated cooling and powered delivery modules in terms of performance.
The Cerribris WSE3 is said to be twice as powerful as the WSE2 capable of hitting a peak speed of 125 peda flaps with one peda flap equal to 1000 trillion computations per second. The Cerribris CS3 system is the engine that powers the new Cerribris inference service and it notably features 7,000 times greater memory than the Nvidia H100 GPU to solve one of generative AI's fundamental technical challenges the need for more memory bandwidth. It solves
that challenge in style. The Cerribris inference service is said to be lightning quick up to 20 times faster than comparable cloud-based inference services that use Nvidia's most powerful GPUs. According to Cerribris it delivers 1800 tokens per second for the open source Lama 3.1 8B model and 450 tokens per second for Lama 3.1 70B. It's competitively priced too with the start-up saying that the service starts at just 10 cents per million tokens
equating to 100 times higher price performance for AI inference workloads. The company adds the Cerribris inference service is especially well suited for agentic AI workloads or AI agents that can perform tasks on behalf of users as such applications need the ability to constantly prompt their underlying models. I've been trying to turn my health around lately and something I found incredibly useful
is my dopure from timeline. Uroflin A is a powerful postbiotic that is nearly impossible to get from your diet alone and my dopure is the first product to offer a precise dose of Uroflin A to upgrade your mitochondrial function, increase cellular energy and improve muscle strength and endurance. My dopure is clinically shown to give our cellular energy generators new power by triggering the body's natural process for removing and rebuilding
damaged mitochondria called mytofagy. One way to think of my dopure is that they are little Pac-Man in your cells, chomping up the damaged mitochondria that makes you feel old and tired and recycling it into new healthy ones. Taking two soft gels a day for two months can help you see significant improvements in your cellular energy, muscle strength and
endurance. After four months of taking mytofure, you'll feel yourself getting stronger, recovering faster after a workout and experiencing less inflammation all part of your healthier aging routine. Right now, timeline is offering 10% off your first order of mytofure. Go to timeline.com slash ride. That's T-I-M-E-L-I-N-E dot com slash ride. Selling a little... or a
lot. Shopify helps you do your thing however you could ching. Shopify is the global commerce platform that helps you sell at every stage of your business from the Launcher Online Shop Stage to the first real-life store stage all the way to the... did we just hit a million order stage? Shopify is there to help you grow. Whether you're selling scented soap or offering outdoor outfits, Shopify helps you sell everywhere from their all-in-one e-commerce platform
to their in-person POS system. Wherever and whatever you're selling, Shopify has got you covered. Shopify helps you turn browsers into buyers with the internet's best converting checkout. 36% better on average compared to other leading commerce platforms. And sell more with less effort thanks to Shopify Magic, your AI-powered All-Star. What I love about Shopify is how it fits whatever you want to sell, however you want to sell it, and however much you want to sell and grow.
Plus Shopify's award-winning help is there to support your success every step of the way. Sign up for a $1 per month trial at Shopify.com slash ride. All lowercase. Go to Shopify.com. slash ride now to grow your business no matter what stage you're in. Shopify.com slash ride. Sources are telling the Washington Post that China-linked hackers have penetrated deep into two big US internet service providers and several smaller ones in recent months using a zero-day flaw in
Versa Network's software. Quote, the unusually aggressive and sophisticated attacks include access to at least two major US providers with millions of customers as well as to several smaller providers people familiar with the separate campaigns said it is business as usual now for China, but that is dramatically stepped up from where it used to be. It is an order of magnitude worse said Brandon Wales, who until earlier this month was executive director of the Cybersecurity
and Infrastructure Security Agency, CISA. The hacks raised concerns because their targets are believed to include government and military personnel working undercover and groups of strategic interests to China. This is privileged high level connectivity to interesting customers said Mike Horka, a former FBI agent and current researcher at Lumen Technologies, which described one of the
campaigns but didn't identify the ISPs it targeted. It was notable he added that the groups considered the effort important enough to exploit previously undiscovered software flaws that could have been preserved for later use. There is no evidence that the new inroads are aimed at anything other
than gathering intelligence. Some of the techniques and resources employed are associated with those used in the past year by a China backed group known as Volt Typhoon, two of the people said US intelligence officials said that group sought access to equipment at Pacific ports and other infrastructure to enable China to soap panic and disrupt America's ability to move troops,
weaponry and supplies to Taiwan if armed conflict breaks out. In a blog made public Tuesday, Lumen said that the hackers used a previously unknown vulnerability known as a zero-day flaw in a program made by Versa Networks for managing wide area networks. Versa acknowledged the critical vulnerability late last week warning only its direct customers. Lumen wrote that it located malware inside ISP routers serving certain groups or individual customers that could intercept passwords
from those customers. Lumen said it believed the malicious software was being used by Volt Typhoon. In a separate report earlier this month, security company Vilexity said it had found another high-end technique in play at a different unnamed ISP. In that case, it said a Chinese state hacking group distinct from Volt Typhoon was able to get far enough inside the service provider to alter the domain name system or DNS web addresses that users were trying to reach and divert them elsewhere,
allowing the hackers to insert backdoors for spying. Though they avoided discussing threats to ISP's specifically, some of the top US cybersecurity officials at the recent Black Hat and DEF CON hacking conferences said Volt Typhoon remained as active and successful as it was when its operations were first identified last year. Quick little omnibus segment here with two feature upgrade headlines. Google has rolled out a Google Meet AI feature that automatically takes notes during meetings
conducted in spoken English, available to select Workspace customers. Quoting the verge. Google Meet's newest AI powered feature takes notes for me, has started rolling out today to Google Workspace customers with the Gemini Enterprise Gemini Education Premium or AI meetings and messaging add-ons. It's similar to Meet's transcription tool, only instead of automatically transcribing what everyone says, it summarizes what everyone talked about. Google first announced this feature at its
2023 cloud next conference. Unfortunately, it only supports spoken English right now, but it seems like it could make missing an important meeting less stressful. It automatically takes notes in a Google doc and will attach that file to the calendar event after the meeting is over, so you can reference them later on. It will also send that Google doc to the meeting organizer and anyone else
who turned the feature on. Running late to a meeting, Google says its new feature will also give you a summary of what you missed, so when you are able to join, you can quickly catch up and no one should have to worry about repeating themselves. The second one is this. Instagram. Now let's use our add text to photos right from its post editor rather than needing a separate app,
and add more photos as stickers on top of a photo, once more from the verge. A bit of text might help your post stand out from the rest of the photos on your feed or help people see information that might otherwise get lost in your caption. From the post editor, you'll also be able to layer another photo on top of a photo as a sticker. When you tap on that layered photo, you can change its shape from a rectangle to a square, circle, heart, or star according to the Instagram blog post.
The feature seems fun to me. I suspect people will find some clever ways to use this in their photos. Finally, today, a catch up on the drips and drabs from the Pavlov Duraft situation Politico says that alongside Pavlov, French authorities have issued an arrest warrant for his telegram co-founder and brother. Nikolai, they did this back in March. Sources are telling the journal that
Emanuel Macron invited Pavlov Duraft to move Telegram to Paris back at a meeting in 2018. Meanwhile, back in 2017, a joint operation between French and UAE spies hacked Duraft's iPhone. What? Quote. The spy operation, which also hasn't been previously reported, was codenamed purple music. The people said French security officials were acutely concerned about Islamic
states' use of Telegram to recruit operatives and plan attacks. Governments have targeted Duraft because of the groups that were drawn to his app, which ranged from pro-democracy demonstrators and dissidents to Islamist militants, drug traffickers, and cyber criminals. For years, the company ignored subpoenas and court orders sent by law enforcement authorities, which piled up in a rarely checked company email address, according to a person close to Duraft.
So it's sounding like the various organizations have just been concerned about what goes on on Telegram for a while now. The US-based Child Safety Group, NC, MEC, Canadian-based CCP, and the UK-based IWF say they're outreach to Telegram to flag CSAM on the platform has largely been ignored. So, is this a Telegram-specific situation? Some of the more pro-clutching tech watchers out there
have said this might actually signal a new, more aggressive crackdown on tech. Forget anti-trust regulation might this lead to the criminalization of tech platforms should say Mark Zuckerberg be wary of traveling to Europe anytime soon. The New York Times asked legal experts about this, and they reported back that Pavel Duraft's arrest may be an outlier, as the legal bar is high in the US and Europe to prosecute tech executives for content posted on their platforms.
Quote, one challenge for prosecutors and law enforcement agencies is proving a tech executive had knowledge of illegal activity on their platforms and did not try to curb the harms, said Daphne Keller, a professor of internet law at Stanford University Law School. That's difficult to demonstrate since TikTok YouTube Snap and Metta, which owns Facebook and Instagram have worked to take down and report illegal content to law enforcement officials,
so their executives can argue they tried to do the right thing. Knowledge is the key issue here, said Ms. Keller, a former lawyer at Ford Google. It's the usual trigger for anyone losing immunity, and quote. Nothing more for you today, talk to you tomorrow.