#151 - Copilot Pro, LLama.cpp, conversational diagnostic AI, secret AI diplomacy

Our 151st episode with a summary and discussion of last week's big AI news!

Check out our sponsor, the SuperDataScience podcast. You can listen to SDS across all major podcasting platforms (e.g., Spotify, Apple Podcasts, Google Podcasts) plus there’s a video version on YouTube.

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

Email us your questions and feedback at [email protected]

Timestamps + links:

• (00:00:00) Intro / Banter
• Tools & Apps
  • (00:02:55) Microsoft’s new Copilot Pro brings AI-powered Office features to the rest of us
  • (00:04:43) Microsoft Copilot is now using the previously-paywalled GPT-4 Turbo, saving you $20 a month
  • (00:07:02) Amazon launches generative AI tool to answer shoppers’ questions
• Applications & Business
  • (00:08:07) DeepMind spin-off aims to halve drug discovery times following Big Pharma deals
  • (00:13:16) China planning 1,600-core chips that use an entire wafer — similar to American company Cerebras 'wafer-scale' designs
  • (00:17:12)  ChatGPT will have video functionality and more accuracy in future versions — Sam Altman says GPT-5 will be a big improvement
  • (00:19:38) Huawei Teardown Shows 5nm Chip Made in Taiwan, Not China
  • (00:22:15) OpenAI’s news publisher deals reportedly top out at $5 million a year
  • (00:25:04) Inside AI Unicorn Anthropic’s Unusual $750 Million Fundraise
  • (00:28:46) Microsoft executive Dee Templeton joins OpenAI board - Bloomberg News
  • (00:31:33) OpenAI-backed 1X raises another $100M for the race to humanoid robots
• Projects & Open Source
  • (00:34:25) Meet LLama.cpp: An Open-Source Machine Learning Library to Run the LLaMA Model Using 4-bit Integer Quantization on a MacBook
  • (00:38:06) LLAMA PRO: Progressive LLaMA with Block Expansion
  • (00:43:48) One of the world’s largest AI training datasets is about to get bigger and ‘substantially better’
• Research & Advancements
  • (00:47:52) Towards Conversational Diagnostic AI
  • (00:51:50)  Sleeper Agents: Training Deceptive LLMs that Persist Through Safety Training
  • (00:56:27) LLM Augmented LLMs: Expanding Capabilities through Composition
  • (01:02:23) Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models
  • (01:05:16) Clinical predictive models created by AI are accurate but study-specific, researchers find
  • (01:09:01) Secure, Governable Chips
• Policy & Safety
  • (01:14:01) US companies and Chinese experts engaged in secret diplomacy on AI safety
  • (01:18:28) China Cyberspace Security Association releases first batch of Chinese basic corpus
  • (01:22:33) OpenAI Bans Use of AI Tools for Campaigning, Voter Suppression
  • (01:24:49) OpenAI Quietly Deletes Ban on Using ChatGPT for “Military and Warfare”
• Synthetic Media & Art
  • (01:27:20) Musicians Set to Begin Contract Negotiations With Studios On AI, Streaming Priorities
  • (01:29:26) Scammy AI-Generated Book Rewrites Are Flooding Amazon
  • (01:33:15) Deepfaked Celebrity Ads Promoting Medicare Scams Run Rampant on YouTube
• (01:35:15) Outro