Show notes: https://thisdayinai.com/bookmarks/32-ep52Groq Mixtral: https://simtheory.ai/agent/567-groq-mixtral-editionGroq Llama: https://simtheory.ai/agent/566-groq-the-speed-oriented-chat-companionSimTheory: https://simtheory.ai====This week we discuss Groq's LPU Chips and the implications of low cost low latency LLMs on custom hardware. We revisit our prank calling to see if Groq's low latency gives an advantage and see if we can improve Air Canada's chatbot. We discuss the launch of Google's Open Source Gamma 7B release and Magic's $148M fundraise for an AI co-worker who can reason. We also cover ChatGPT losing it's mind during the week.
If you like the show, please consider subscribing. Thanks for listening.
====Chapters:00:00 - Groq, Groq API and Retell with Groq32:48 - Google Gemma 7B Open Source Model39:04 - The 'Magic' Breakthrough on Reasoning and Context50:19 - Sounds for OpenAI Sora Thanks to ElevenLabs Sound FX51:59 - ChatGPT Goes Haywire