Glossary
Reranking
A second pass that reorders retrieved results by how well they answer the question.
Reranking is a second retrieval step in which a more precise model rescores a short list of candidate passages and puts the most relevant ones first. The first search is fast and broad, and the reranker, often a cross-encoder, reads the query and each passage together to judge the match. Only the top few passages are then passed to the language model.
The usual pattern is to retrieve a generous set of candidates, rerank them, and keep a handful. Rerankers cost more per item than a vector lookup, which is why they run only on the short list.
Reranking is one of the most common fixes when a RAG system retrieves roughly the right material but ranks it badly. It adds latency and cost, so it should be tested against your own questions before you keep it.
Start in 60 seconds
Put this to work on your project.
Get an AI-assisted, architect-reviewed scope, cost range, and timeline. Free, no login.