cover of episode How vector search and semantic ranking improve your AI prompts

How vector search and semantic ranking improve your AI prompts

2023/10/24
logo of podcast Microsoft Mechanics Podcast

Microsoft Mechanics Podcast

Frequently requested episodes will be transcribed first

Shownotes Transcript

Improve the information retrieval process, so you have the most optimal set of grounding data needed to generate useful AI responses. See how Azure Cognitive Search combines different search strategies out of the box and at scale - so you don’t have to.

Keyword search—match the exact words to search your grounding data

Vector search—focuses on conceptual similarity, where the app is using part of the dialogue to retrieve grounding information

Hybrid approach—combines both keyword and vector searches

Semantic ranking—to boost precision, a re-ranking step can re-score the top results using a larger deep learning ranking model

Pablo Castro, Azure AI Distinguished Engineer, shows how to improve the quality of generative AI responses using Azure Cognitive Search.

  ► QUICK LINKS: 00:00 - How to generate high-quality AI responses 01:06 - Improve quality of generative AI outputs 02:56 - Why use vectors? 04:57 - Vector Database 06:56 - Apply to real data and text 08:00 - Vectors using images09:40 - Keyword search11:22 - Hybrid retrieval 12:18 - Re-ranking 14:18 - Wrap up

  ► Link References Sample code available at https://aka.ms/MechanicsVectors) Complete Copilot sample app at https://aka.ms/EntGPTSearch) Evaluation details for relevance quality at https://aka.ms/ragrelevance)

  ► Unfamiliar with Microsoft Mechanics? As Microsoft's official video series for IT, you can watch and share valuable content and demos of current and upcoming tech from the people who build it at Microsoft. • Subscribe to our YouTube: https://www.youtube.com/c/MicrosoftMechanicsSeries) • Talk with other IT Pros, join us on the Microsoft Tech Community: https://techcommunity.microsoft.com/t5/microsoft-mechanics-blog/bg-p/MicrosoftMechanicsBlog) • Watch or listen from anywhere, subscribe to our podcast: https://microsoftmechanics.libsyn.com/podcast)

  ► Keep getting this insider knowledge, join us on social: • Follow us on Twitter: https://twitter.com/MSFTMechanics) • Share knowledge on LinkedIn: https://www.linkedin.com/company/microsoft-mechanics/) • Enjoy us on Instagram: https://www.instagram.com/msftmechanics/) • Loosen up with us on TikTok: https://www.tiktok.com/@msftmechanics)