AWS Builder Center
Choosing a Vector Store for Amazon Bedrock Knowledge Bases

Choosing a Vector Store for Amazon Bedrock Knowledge Bases

Learn how to choose a vector store for Amazon Bedrock Knowledge Bases by comparing search capabilities, relational integration, storage economics, graph relationships, scalability, security, and operational requirements.

A RAG application stores document embeddings so it can find information related to a user’s question. Several services can do this job, but they serve different needs.
Amazon OpenSearch Service, for example, is mainly a search and analytics service not a dedicated vector database. However, it can store, index, and search embeddings, so it can act as a vector store for Amazon Bedrock Knowledge Bases.
The goal is to choose what fits your data, traffic, search needs, budget, and existing systems.

What does this storage layer do?

An embedding model converts each document chunk into a list of numbers called a vector. The storage and search service then:
  • stores the vector with the original text and metadata;
  • organizes the vectors so they can be searched quickly;
  • compares a user’s query vector with stored vectors;
  • returns the most similar document chunks;
  • applies filters such as tenant, product, language, or date.
It does not create the embeddings or write the final answer. It helps the RAG application find the evidence that the model will use.

First choose how much AWS should manage

Amazon Bedrock offers two broad approaches.

Managed Knowledge Base

With a fully managed Bedrock Knowledge Base, AWS manages the underlying datastore, indexing, scaling, and retrieval infrastructure.
Choose this when you want to build RAG without selecting and operating a separate vector-storage service.

Customer-managed Knowledge Base

With a customer-managed Knowledge Base, you choose a supported service. This fits workloads needing a particular database, search feature, network setup, or existing integration.

Questions to answer before choosing

Start with the workload:
  • How many document chunks will you store?
  • How quickly will data and traffic grow?
  • How fast must searches be?
  • Do you need exact keyword search as well as meaning-based search?
  • Do you need filters for tenants, products, dates, or permissions?
  • Must vectors work with relational or graph data?
  • Which databases does your team already use?
  • What are the security and budget requirements?
These answers matter more than a generic performance chart.

Amazon OpenSearch Service

OpenSearch is a search and analytics service that can also act as a vector store.
It fits applications where search is central. It supports vector similarity, text search, filtering, and under supported Bedrock configurations hybrid search.
Hybrid search combines meaning-based and exact-word search, helping with error codes, IDs, and product names.
Consider OpenSearch when:
  • you need strong search features;
  • hybrid search is important;
  • the amount of data or search traffic may grow;
  • your team can manage indexes, permissions, networking, and capacity.

Amazon Aurora PostgreSQL

Aurora PostgreSQL is a relational database that can store and search vectors through PostgreSQL vector capabilities.
It is useful when your application already uses PostgreSQL or needs to combine vector results with tables, SQL queries, transactions, or business records.
Consider Aurora when:
  • PostgreSQL is already part of the application;
  • you need SQL and vector search together;
  • vectors must stay close to structured business data.
Test vector volume, simultaneous queries, and database capacity before scaling.

Amazon S3 Vectors

Amazon S3 Vectors provides vector buckets and indexes without provisioning database servers. It emphasizes storage efficiency over the lowest possible latency.
Consider S3 Vectors when:
  • the vector collection is large;
  • searches are infrequent or moderate;
  • keeping storage costs lower is important;
  • sub-second results meet the application’s needs.
Check feature support carefully. Some filters and advanced chunking combinations have limitations, and hierarchical chunking is not recommended with S3 vector buckets.

Amazon Neptune Analytics

Neptune Analytics is designed for graph analytics and can combine graph relationships with vector search.
Vector search finds similar meaning. A graph also shows connections, such as service dependencies or incidents affecting products.
Consider Neptune Analytics when:
  • relationships are important to the answer;
  • you are building a GraphRAG solution;
  • questions require connections across several entities.
Do not add a graph unless those relationships solve a real retrieval problem.

Supported third-party services

Bedrock Knowledge Bases also supports services such as Pinecone, Redis Enterprise Cloud, and MongoDB Atlas.
These may fit an existing platform strategy. Include external credentials, networking, billing, and support responsibilities in the decision.

A simple starting point

If you mainly need...
Start by evaluating...
A fully managed Bedrock datastore and retrieval experience
Managed Bedrock Knowledge Base
Strong text search and hybrid retrieval
OpenSearch Serverless or managed OpenSearch
SQL, relational data, and vector search together
Aurora PostgreSQL
Cost-efficient storage for a large vector collection
S3 Vectors
Graph relationships combined with vector search
Neptune Analytics
Integration with a platform you already use
A supported third-party service
Confirm Region availability, dimensions, filtering, search features, security, quotas, and pricing for your setup.

Test with your own data

Test real documents and common questions. Measure:
  1. whether the correct chunks are retrieved;
  1. how quickly results appear;
  1. how performance changes with more users;
  1. whether filters and permissions work correctly;
  1. how exact terms and natural-language questions perform;
  1. how much storage, processing, and searching cost.
Online benchmarks may use different data, vectors, filters, and traffic, so they may not predict your results.

Security and cost considerations

  • Give the Knowledge Base and storage service only the permissions they need.
  • Encrypt data and use private connectivity when required.
  • Apply user and tenant permissions before returning documents.
  • Store third-party credentials securely.
  • Monitor changes to indexes and access policies.
  • Plan how data will be deleted, backed up, and recovered.
Include ingestion, compute, searches, backups, data transfer, idle capacity, and management time not only storage price.

Common mistakes: what to check and how to fix them

Common mistake
What to check
How to fix it
Choosing a service because it did well in an online test
Was the test similar to your data and traffic?
Test with your own documents and common questions
Paying for more performance than you need
How often do users search, and how fast must results appear?
Choose a simpler or more cost-effective option if traffic is low
Choosing a cheaper option that lacks an important feature
Does it support the search type, filters, and metadata you need?
Write down required features first and choose a compatible service
Ignoring a database your application already uses
Could your existing PostgreSQL or supported platform handle the vectors?
Reuse it if it meets performance, security, and scaling needs
Documents fail during indexing
Do the index dimensions match the embedding model’s output?
Correct or recreate the index, then process the documents again
Users receive missing or unauthorized results
Are metadata and permission filters configured correctly?
Standardize access metadata and test with different users and roles
Search becomes slow as the application grows
Was the service tested with realistic data and simultaneous users?
Run load tests, adjust capacity, and monitor growth
The bill is higher than expected
Which costs come from storage, queries, processing, or unused capacity?
Remove unused resources, right-size capacity, and track each cost separately

Key takeaways

OpenSearch is a search service that can act as a vector store. Aurora fits relational data, S3 Vectors focuses on storage economics, and Neptune supports graph relationships.
Start with your workload, shortlist the compatible options, and test them with real data.
The right choice is the one that delivers the retrieval quality, speed, security, scale, and cost your application actually needs.
Any opinions in this article are those of the individual author and may not reflect the opinions of AWS.
Enjoyed reading this content? Let the author know!

Your likes, comments, shares, and saves help creators reach more builders.

Loading recommendations

Loading article