cover of episode 650: SparseGPT: Remove 100 Billion Parameters but Retain 100% Accuracy

650: SparseGPT: Remove 100 Billion Parameters but Retain 100% Accuracy

2023/2/3
logo of podcast Super Data Science: ML & AI Podcast with Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

Frequently requested episodes will be transcribed first

Shownotes Transcript

SparseGPT is a noteworthy one-shot pruning technique that can halve the size of large language models like GPT-3 without adversely affecting accuracy. In this episode, Jon Krohn provides an overview of this development and explains its commercial and environmental implications.

Additional materials: www.superdatascience.com/650)

Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast) for sponsorship information.