Blog
-
Context Window
The maximum amount of text, measured in tokens, that a language model can process in a single request — input and output together.
-
Reranking
A second scoring pass that reorders an already-retrieved candidate set using a slower, more accurate model that reads query and document together.
-
Vector Index
A data structure that stores embeddings and finds the ones nearest to a query vector without comparing against every stored vector.
-
Chunk
A unit of text stored and retrieved as a single item in a retrieval system — the smallest thing a search can return. No standard size exists.
-
Embedding
A fixed-length list of numbers representing a piece of text, produced so that texts with similar meanings land near one another in the space.