Glossary
Chunking
Splitting documents into passages that are indexed and retrieved one at a time.
Chunking is the step in a RAG pipeline that splits documents into smaller passages, called chunks, before they are embedded and indexed. Retrieval then returns chunks, not whole files, so how you split decides whether the right answer can be found and whether it arrives with enough context to be useful.
Common approaches are fixed-size splits, recursive splits that follow headings, paragraphs and sentences, and semantic splits that cut where the topic changes. Newer methods add context to each chunk, such as a short generated summary of where it sits in the document, or embed the whole document first and split afterward.
There is no single best setting. Chunk size, overlap and structure depend on your documents, so teams compare options on a set of real questions. Metadata such as title, section and permissions should travel with every chunk.
Start in 60 seconds
Put this to work on your project.
Get an AI-assisted, architect-reviewed scope, cost range, and timeline. Free, no login.