Senior AI Context Engineer: RAG & Semantic Retrieval

GEHA Health; United States; Hybrid; USD 125,000 - 158,000; Full time

Benefits offered by this job

Competitive pay

Incentive plan

Health benefits

401(k)

Well-being program

Paid time off

Community enrichment time

Life and AD&D

Disability insurance

Tuition assistance

Job summary

G.E.H.A, Government Employees Health Association, Inc., is seeking a Senior AI Context Engineer in Digital Innovation to turn enterprise data into precise, high-quality context for AI tools. You will own extraction, chunking, vector indexing and RAG retrieval across HIPAA-compliant environments.

Working with the Sr. AI Solutions Architect and AI Full Stack Developers, you’ll design secure data enrichment, access controls and scalable context services to support GenAI features in a

Qualifications

• 5+ years of backend software engineering or data-centric development.
• 1–2 years optimizing AI/RAG architectures, prompt context strategies, and vector retrieval pipelines for LLM applications.

Responsibilities

• Extraction & Chunking: Build and refine parsing to contextual units for LLMs in partnership with cross-functional teams.
• Semantic Search & Reranking: Implement hybrid search, metadata routing, and reranking for precision.
• Agentic Context Services: Design context payloads for Model Context Protocol (MCP) servers and LLM orchestration tools.
• Index Design & Optimization: Implement vector indexing and embedding schemes in enterprise vector stores.
• Vector Metadata: Design tagging schemes for precise filtering and context retrieval.
• Retrieval Evaluation & Groundedness: Establish frameworks to monitor retrieval relevance and embedding drift.

Skills

Backend engineering

GenAI & RAG

Python

SQL

Security & privacy

Data-centric development

Tools

Airflow

Prefect

Temporal

LlamaIndex

Unstructured.io

LangChain

Pinecone

pgvector

Weaviate

Qdrant

Azure AI Search

Job description

G.E.H.A, Government Employees Health Association, Inc., is seeking a Senior AI Context Engineer in Digital Innovation to turn enterprise data into precise, high-quality context for AI tools. You will own extraction, chunking, vector indexing and RAG retrieval across HIPAA-compliant environments.

Working with the Sr. AI Solutions Architect and AI Full Stack Developers, you’ll design secure data enrichment, access controls and scalable context services to support GenAI features in a