AI-Powered Search - by Trey Grainger & Doug Turnbull & Max Irwin (Paperback)

About the Book

AI-Powered Search teaches you the latest machine-learning techniques. Ideal for software developers or data scientists familiar with the basics of search engine development, it will show you ways to create content that will constantly get smarter and automatically deliver better, more relevant search experiences

Book Synopsis

Apply cutting-edge machine learning techniques--from crowdsourced relevance and knowledge graph learning, to Large Language Models (LLMs)--to enhance the accuracy and relevance of your search results.

Delivering effective search is one of the biggest challenges you can face as an engineer. AI-Powered Search is an in-depth guide to building intelligent search systems you can be proud of. It covers the critical tools you need to automate ongoing relevance improvements within your search applications.

Inside you'll learn modern, data-science-driven search techniques like:

- Semantic search using dense vector embeddings from foundation models
- Retrieval augmented generation (RAG)
- Question answering and summarization combining search and LLMs
- Fine-tuning transformer-based LLMs
- Personalized search based on user signals and vector embeddings
- Collecting user behavioral signals and building signals boosting models
- Semantic knowledge graphs for domain-specific learning
- Semantic query parsing, query-sense disambiguation, and query intent classification
- Implementing machine-learned ranking models (Learning to Rank)
- Building click models to automate machine-learned ranking
- Generative search, hybrid search, multimodal search, and the search frontier

AI-Powered Search will help you build the kind of highly intelligent search applications demanded by modern users. Whether you're enhancing your existing search engine or building from scratch, you'll learn how to deliver an AI-powered service that can continuously learn from every content update, user interaction, and the hidden semantic relationships in your content. You'll learn both how to enhance your AI systems with search and how to integrate large language models (LLMs) and other foundation models to massively accelerate the capabilities of your search technology.

Foreword by Grant Ingersoll.

Purchase of the print book includes a free eBook in PDF and ePub formats from Manning Publications.

About the technology

Modern search is more than keyword matching. Much, much more. Search that learns from user interactions, interprets intent, and takes advantage of AI tools like large language models (LLMs) can deliver highly targeted and relevant results. This book shows you how to up your search game using state-of-the-art AI algorithms, techniques, and tools.

About the book

AI-Powered Search teaches you to create a search that understands natural language and improves automatically the more it is used. As you work through dozens of interesting and relevant examples, you'll learn powerful AI-based techniques like semantic search on embeddings, question answering powered by LLMs, real-time personalization, and Retrieval Augmented Generation (RAG).

What's inside

- Sparse lexical and embedding-based semantic search
- Question answering, RAG, and summarization using LLMs
- Personalized search and signals boosting models
- Learning to Rank, multimodal, and hybrid search

About the reader

For software developers and data scientists familiar with the basics of search engine technology.

About the author

Trey Grainger is the Founder of Searchkernel and former Chief Algorithms Officer and SVP of Engineering at Lucidworks. Doug Turnbull is a Principal Engineer at Reddit and former Staff Relevance Engineer at Spotify. Max Irwin is the Founder of Max.io and former Managing Consultant at OpenSource Connections.

Table of Contents
Part 1
1 Introducing AI-powered search
2 Working with natural language
3 Ranking and content-based relevance
4 Crowdsourced relevance
Part 2
5 Knowledge graph learning
6 Using context to learn domain-specific language
7 Interpreting query intent through semantic search
Part 3
8 Signals-boosting models
9 Personalized search
10 Learning to rank for generalizable search relevance
11 Automating learning to rank with click models
12 Overcoming ranking bias through active learning
Part 4
13 Semantic search with dense vectors
14 Question answering with a fine-tuned large language model
15 Foundation models and emerging search paradigms
A Running the code examples
B Supported search engines and vector database

From the Back Cover

Great search is all about delivering the right results. Today's search engines are expected to be smart and understand the nuances of natural language queries, as well as each user's preferences and context.

AI-Powered Search is an authoritative guide to applying leading-edge data science techniques to search. It teaches you how to build search engines that automatically understand the intention of a query in order to deliver significantly better results.

Author Trey Grainger is an expert on leading techniques for crowdsourced relevancy and semantic search and has helped develop numerous algorithms which have transformed search. Working through code in interactive notebooks, you will deploy intelligent search systems that deliver real-time personalisation and contextual understanding of each user, domain, and query through a self-learning search platform that can tune its own results automatically.

About the reader

For software developers or data scientists familiar with the basics of search engine development.

Review Quotes

"Great grounding in advanced search topics like signals boosting, while not ignoring the basics at the same time."
Ian Pointer

"If someone was building an AI-Powered Search application, I'd point them to this book as reference."
George Seif

"Nothing compares to this book."
Al Krinker

About the Author

Trey Grainger is the Chief Algorithms Officer at Lucidworks, the AI-powered search company that powers hundreds of the world's leading organizations. Trey co-authored Solr in Action and has over 12 years experience building semantic search engines, recommendation engines, real-time analytics systems, and leading related engineering and data science teams.

Doug Turnbull is Staff Relevance Engineer at Spotify and is the former Chief Technical Officer at OpenSource Connections. He is the co-author of the book Relevant Search, and contributed chapters 10-12 on "Learning to Rank", "Automated Learning to Rank with Click Models", and "Overcoming Bias in Learned Relevance Models".

Max Irwin is a Managing Consultant at OpenSource Connections, a leading search relevance consultancy. Max contributed chapters 13-14 on "Semantic Search with Dense Vectors" and "Question Answering and the Search Frontier".