Senior AI Engineer – Applied AI & RAG Pipelines

Blue Origin LLC; Seattle (WA); On-site; USD 164,652 - 230,512; Full time

Benefits offered by this job

Medical, dental, vision

401(k) with company match

Stock options

Paid time off

Job summary

Blue Origin LLC seeks a Software Engineer III - Applied AI to own the architecture and delivery of agentic AI and RAG-powered platforms. You will drive retrieval quality, build LLM evaluation frameworks, and deliver production-grade frontends with deep observability across AWS infrastructure.

You will mentor junior engineers, collaborate with product and design teams, and help mature engineering standards while focusing on reliability and scalable AI solutions for enterprise knowledge graphs and

Qualifications

• 5+ years of software engineering with production systems ownership.
• Fluent with LLMs as a development tool and AI-first features.
• Experience building LLM/RAG pipelines from embedding to reranking and evaluation.

Responsibilities

• Lead full-stack development of search, RAG, and agentic AI apps using Python, TS/React, and Java.
• Own retrieval pipeline quality and evaluation harnesses for embedding models and end-to-end RAG quality.
• Build LLM evaluation frameworks and automated regression suites.
• Architect production-grade React frontends with robust state management.
• Establish observability standards and dashboards for AI systems.
• Design and operate AWS infrastructure with IaC and CI/CD gates.
• Mentor junior engineers and collaborate with product and design teams.

Skills

LLM development

Python

TypeScript/React

Java

Frontend engineering

Backend engineering

Observability

AWS

Terraform/CDK

CI/CD

Mentoring

Cross-functional collaboration

Education

Bachelor’s degree in Computer Science or related field

Tools

OpenSearch

CloudWatch

X-Ray/OpenTelemetry

Terraform

CDK

React tooling

Job description

Blue Origin LLC seeks a Software Engineer III - Applied AI to own the architecture and delivery of agentic AI and RAG-powered platforms. You will drive retrieval quality, build LLM evaluation frameworks, and deliver production-grade frontends with deep observability across AWS infrastructure.

You will mentor junior engineers, collaborate with product and design teams, and help mature engineering standards while focusing on reliability and scalable AI solutions for enterprise knowledge graphs and