You upsert a document and query for it 200 milliseconds later, but it never appears. Pick the most likely cause.
Options
The write landed in a buffer or fresh segment that is not yet searchable; the index has a freshness lag between acknowledged write and queryable vector
The vector was silently rejected because its values were not normalized to unit length
ANN search is approximate, so a brand new vector has a permanently lower chance of being found
The query embedding model must be restarted before it can see new vectors
Real products, models, and research that use this idea.
- Pinecone serverless documents a freshness layer with second scale staleness for the most recent writes before they merge into the main index
- Elasticsearch and OpenSearch ship with a one second default refresh interval; per request refresh exists for tests but is the wrong default for production