cover of episode Last Week in AI #189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

Last Week in AI #189 - Chat.com, FrontierMath, Relaxed Transformers, Trump & AI

2024/11/17
logo of podcast Last Week in AI

Last Week in AI

AI Deep Dive AI Chapters Transcript
People
A
Andrey Kurenkov
J
Jeremie Harris
Topics
Andrey Kurenkov 介绍了 OpenAI 的新功能"预测输出",该功能可以显著提高 GPT-4 在特定任务上的速度。Jeremie Harris 补充解释了该功能背后的技术细节,即推测解码,并分析了其工作原理和优势。该功能通过并行处理多个候选 token,并固定输入中不需要修改的部分,从而提高了效率并降低了成本。此外,Andrey Kurenkov 还提到了 Barnaby AI 与 OpenAI 的合作测试,证实了该功能在实际应用中的有效性。关于 Anthropic 的 Haiku 3.5,Andrey Kurenkov 指出其价格上涨,并分析了其定价策略。Jeremie Harris 则认为 Haiku 3.5 的高定价反映了大型语言模型市场可能并非完全商品化,因为 Anthropic 正在根据质量而非成本进行定价。

Deep Dive

Chapters
This chapter discusses recent updates in AI tools and apps, including OpenAI's 'Predicted Outputs' feature, Anthropic's Haiku 3.5 price hike, and the introduction of FLUX1.1 Ultra and Raw Modes.
  • OpenAI's 'Predicted Outputs' feature speeds up GPT-4o by ~5x for tasks like editing docs or refactoring code.
  • Anthropic raises eyebrows with a price hike for Haiku 3.5, citing increased intelligence.
  • FLUX1.1 Ultra and Raw Modes are introduced by Black Forest Labs.

Shownotes Transcript

Our 189th episode with a summary and discussion of last week's big AI news!

Hosted by Andrey Kurenkov) and Jeremie Harris). Feel free to email us your questions and feedback at [email protected] )and/or [email protected])

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/).

Sponsors:

  • The Generator -) An interdisciplinary AI lab empowering innovators from all fields to bring visionary ideas to life by harnessing the capabilities of artificial intelligence.

  • The AI safety book “)Uncontrollable") which is not a doomer book, but instead lays out the reasonable case for AI safety and what we can do about it. Max TEGMARK said that “Uncontrollable” is a captivating, balanced, and remarkably up-to-date book on the most important issue of our time" - find it on Amazon today!)

If you would like to become a sponsor for the newsletter, podcast, or both, please fill out this form).

Timestamps + Links:

(00:00:00) Intro / Banter

(00:01:28) News Preview

(00:02:10) Response to listener comments

(00:05:02) Sponsor Break

Tools & Apps

(00:07:31) OpenAI Introduces ‘Predicted Outputs’ Feature: Speeding Up GPT-4o by ~5x for Tasks like Editing Docs or Refactoring Code)

(00:11:55) Anthropic’s Haiku 3.5 surprises experts with an “intelligence” price increase)

(00:17:10) Introducing FLUX1.1 [pro] Ultra and Raw Modes)

(00:19:11) X is testing a free version of Grok AI chatbot in select regions)

Applications & Business

(00:21:39) OpenAI acquired Chat.com)

(00:23:40) Saudis Plan $100 Billion AI Powerhouse to Rival UAE Tech Hub)

(00:28:28) Meta’s former hardware lead for Orion is joining OpenAI)

(00:31:38) OpenAI Accidentally Leaked Its Upcoming o1 Model to Anyone With a Certain Web Address)

(00:35:50) Nvidia Rides AI Wave to Pass Apple as World’s Largest Company)

Projects & Open Source

(00:37:53) ‘Unrestricted’ AI group Nous Research launches first chatbot — with guardrails)

(00:41:48) FrontierMath: The Benchmark that Highlights AI’s Limits in Mathematics)

(00:46:29) Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by Tencent)

Research & Advancements

(00:49:55) Applying “Golden Gate Claude” mechanistic interpretability techniques to protein language models.)

(00:58:3) Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA)

(01:05:55) From Naptime to Big Sleep: Using Large Language Models To Catch Vulnerabilities In Real-World Code)

(01:10:22) OpenAI reportedly developing new strategies to deal with AI improvement slowdown)

Policy & Safety

(01:19:52)  What Donald Trump’s Win Means For AI)

(01:28:44) Fab Whack-A-Mole: Chinese Companies are Evading U.S. Sanctions)

(01:33:57) US fines GlobalFoundries for shipping chips to sanctioned Chinese firm)

(01:36:55) Anthropic teams up with Palantir and AWS to sell its AI to defense customers)

(01:39:23) Outro