cover of episode #189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

#189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

2024/11/17
logo of podcast Last Week in AI

Last Week in AI

AI Deep Dive AI Chapters Transcript
People
A
Andrey Kurenkov
Topics
Andrey Kurenkov 介绍了 OpenAI 的新功能“预测输出”,该功能可以显著提高 GPT-4o 在特定任务上的速度。他还提到了 Anthropic 将 Haiku 3.5 的价格提高了四倍,引发了对大型语言模型经济效益的讨论。Jeremie Harris 补充解释了推测解码技术的原理及其在实际应用中的优势,并分析了 Anthropic 定价策略背后的市场逻辑和对 AI 模型商品化程度的影响。

Deep Dive

Chapters
OpenAI acquires the domain chat.com and former Meta hardware lead joins OpenAI to focus on robotics and AI integration into physical products.
  • OpenAI acquires chat.com domain for a significant sum.
  • Former Meta hardware lead Kevin Colangelo joins OpenAI to focus on robotics and AI integration.
  • OpenAI's strategy includes integrating ChatGPT into robots and physical products.

Shownotes Transcript

Our 189th episode with a summary and discussion of last week's big AI news!

Hosted by Andrey Kurenkov) and Jeremie Harris). Feel free to email us your questions and feedback at [email protected] )and/or [email protected])

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/).

In this episode:

  • OpenAI's acquisition of chat.com and internal shifts, including hardware lead hire and hardware model leaks, signal significant strategy pivots and challenges with model scaling and security. 
  • Saudi Arabia plans a $100 billion AI initiative aiming to rival UAE's tech hub, highlighting the region's escalating AI investments. 
  • U.S. penalties on GlobalFoundries for violating sanctions against SMIC underline ongoing challenges in enforcing AI-chip export controls. 
  • Anthropic collaborates with Palantir and AWS to integrate CLAWD into defense environments, marking a significant policy shift for the company.

Sponsors:

  • The Generator -) An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.

  • The AI safety book “)Uncontrollable") which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today!)

If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form).

Timestamps + Links:

(00:00:00) Intro / Banter

(00:01:28) News Preview

(00:02:10) Response to listener comments

(00:05:02) Sponsor Break

Tools & Apps

(00:07:31) OpenAI Introduces ‘Predicted Outputs’ Feature: Speeding Up GPT-4o by ~5x for Tasks like Editing Docs or Refactoring Code)

(00:11:55) Anthropic’s Haiku 3.5 surprises experts with an “intelligence” price increase)

(00:17:10) Introducing FLUX1.1 [pro] Ultra and Raw Modes)

(00:19:11) X is testing a free version of Grok AI chatbot in select regions)

Applications & Business

(00:21:39) OpenAI acquired Chat.com)

(00:23:40) Saudis Plan $100 Billion AI Powerhouse to Rival UAE Tech Hub)

(00:28:28) Meta’s former hardware lead for Orion is joining OpenAI)

(00:31:38) OpenAI Accidentally Leaked Its Upcoming o1 Model to Anyone With a Certain Web Address)

(00:35:50) Nvidia Rides AI Wave to Pass Apple as World’s Largest Company)

Projects & Open Source

(00:37:53) ‘Unrestricted’ AI group Nous Research launches first chatbot — with guardrails)

(00:41:48) FrontierMath: The Benchmark that Highlights AI’s Limits in Mathematics)

(00:46:29) Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent)

Research & Advancements

(00:49:55) Applying “Golden Gate Claude” mechanistic interpretability techniques to protein language models.)

(00:58:3) Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA)

(01:05:55) From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code)

(01:10:22) OpenAI reportedly developing new strategies to deal with AI improvement slowdown)

Policy & Safety

(01:19:52)  What Donald Trump’s Win Means For AI)

(01:28:44) Fab Whack-A-Mole: Chinese Companies are Evading U.S. Sanctions)

(01:33:57) US fines GlobalFoundries for shipping chips to sanctioned Chinese firm)

(01:36:55) Anthropic teams up with Palantir and AWS to sell its AI to defense customers)

(01:39:23) Outro