RAG Data & Embeddings Architect, Vector DB & Retrieval

Bank of America; Town of Charlotte (NY); On-site; USD 180,000 - 260,000; Full time

Job summary

Bank of America is seeking an experienced RAG Data & Embeddings Architect to define and govern vector databases, embedding strategies, and hybrid retrieval for enterprise AI applications. You will shape architecture, guide multi-team delivery, and drive scalable, compliant data retrieval and knowledge management at scale.

You will mentor engineers, evaluate vector DB platforms, and collaborate with risk, security, and product partners to ensure reliable, explainable, and cost-efficient AI

Qualifications

• 10+ years of software engineering, data engineering, platform engineering, or AI engineering experience.
• 5+ years designing large-scale enterprise systems.
• 2+ years with LLM, RAG, vector search, or AI platform capabilities.

Responsibilities

• Define the engineering approach for the program/portfolio and enable delivery of technical enablers.
• Lead design of complex features spanning multiple teams and explore solution options.
• Guide architecture reviews and code quality within the domain.
• Set the technology stack for the solution within approved tools.
• Create and refine patterns, standards, and guardrails for enterprise AI platforms.

Skills

Automation

Influence

Result Orientation

Stakeholder Management

Technical Strategy Development

Application Development

Architecture

Business Acumen

Risk Management

Solution Design

Agile Practices

Analytical Thinking

Collaboration

Data Management

Solution Delivery Process

Education

Bachelor’s degree in Computer Science, Engineering, Information Systems, Applied Mathematics, or a related technical field

Tools

Azure AI Search

Cosmos DB vector search

Pinecone

Weaviate

Milvus

OpenSearch/Elasticsearch

PostgreSQL/pgvector

Job description

Bank of America is seeking an experienced RAG Data & Embeddings Architect to define and govern vector databases, embedding strategies, and hybrid retrieval for enterprise AI applications. You will shape architecture, guide multi-team delivery, and drive scalable, compliant data retrieval and knowledge management at scale.

You will mentor engineers, evaluate vector DB platforms, and collaborate with risk, security, and product partners to ensure reliable, explainable, and cost-efficient AI