RAG Platform Architect & Lead ML Engineer

Compunnel Inc.

Mason (OH)

Hybrid

USD 100,000 - 130,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Compunnel, Inc. is seeking a Lead Engineer to oversee the architecture and delivery of a production-grade RAG platform. The ideal candidate will have experience integrating data from AWS Aurora MySQL and DocumentDB, and optimizing responses using OpenAI models.

This role requires strong leadership skills and experience in Python, with responsibilities including technical design, implementation, and mentoring. The position promotes best practices in engineering and tool integration.

Qualifications

  • 8+ years of strong hands-on Python backend/data engineering experience.
  • Prior experience as a Lead/Tech Lead owning architecture and delivery of production systems.
  • Proven experience shipping RAG/LLM applications in production.

Responsibilities

  • Own end-to-end architecture for ingestion, indexing, retrieval, and LLM orchestration (RAG).
  • Lead implementation in Python, including hands-on coding, design reviews, and establishing standards.
  • Provide technical leadership, mentor engineers, set coding standards, and conduct design/code reviews.

Skills

Python backend/data engineering
OpenAI APIs
MongoDB Atlas Vector Search
API/service development
Engineering excellence practices

Tools

Docker
CI/CD
FastAPI

Job description

JOB SUMMARY
We are looking for a Lead Engineer to own the architecture and delivery of a production-grade RAG platform. The solution will extract and unify data from AWS Aurora MySQL and AWS DocumentDB, index knowledge using MongoDB Atlas Vector Search, and generate grounded responses using OpenAI models. This role will lead technical design, implementation, quality, and mentoring, and will establish best practices for tool integration and safe context retrieval.

Key Responsibilities
- Own end-to-end architecture for ingestion, indexing, retrieval, and LLM orchestration (RAG).
- Lead implementation in Python, including hands-on coding, design reviews, and establishing standards.
- Build and optimize data extraction pipelines from AWS Aurora MySQL (SQL optimization, indexing, incremental loads/CDC-style approaches) and AWS DocumentDB (aggregation pipelines, indexing, incremental sync patterns).
- Design chunking/metadata strategy and indexing into MongoDB Atlas Vector Search, including schema design, versioning, upserts/deletes, and re-embedding strategy.
- Implement vector search with metadata filters (tenant, source, permissions, time range).
- Integrate OpenAI for embeddings and generation, focusing on prompting for grounded responses, structured outputs, and citations/source tracking.
- Ensure reliability through retries, batching, caching, rate-limit handling, and cost/performance controls.
- Implement patterns for safe retrieval and extensible tooling, including tool schemas, permissions, audit logs, and deterministic tool behavior.
- Establish production readiness with observability (logs/metrics/tracing), alerting, incident response runbooks, and testing strategy (unit/integration).
- Implement CI/CD and secure secret management.
- Provide technical leadership, mentor engineers, set coding standards, and conduct design/code reviews.
- Coordinate with product, data, and security stakeholders and manage the technical roadmap.

Required Qualifications
- 8+ years of strong hands-on Python backend/data engineering experience (or equivalent depth).
- Prior experience as a Lead/Tech Lead owning architecture and delivery of production systems.
- Proven experience shipping RAG/LLM applications in production.
- Strong experience with OpenAI APIs (embeddings, chat, tool/function calling patterns).
- Hands-on experience with MongoDB Atlas Vector Search: index creation/tuning, schema design, metadata filtering, multi-tenant patterns.
- Strong integration experience with Aurora MySQL (performance tuning, incremental sync) and DocumentDB (queries/aggregations, indexing, performance).
- Experience with API/service development (FastAPI preferred) and background jobs (Celery/RQ/SQS/Kafka).
- Experience with engineering excellence practices: Docker, CI/CD, pytest, secure secrets, monitoring, performance tuning.

Preferred Qualifications
- Hybrid retrieval (keyword + vector), reranking, and evaluation frameworks (RAGAS/TruLens).
- Document parsing/OCR, table extraction, knowledge graph/entity resolution.
- AWS deployment experience (ECS/EKS/Lambda), VPC networking, IAM best practices.

Certifications

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer II
ML Engineer II

Compunnel Inc. • Mason (OH)

Hybrid
USD 100,000 - 130,000
Expert RAG Engineer
Expert RAG Engineer

Salvo Software • United States

Remote
USD 180,000 - 240,000
Retrieval-Augmented Generation (RAG) System - Senior Software Developer
Retrieval-Augmented Generation (RAG) System - Senior Software Developer

Elsevier • Philadelphia

On-site
USD 120,000 - 150,000
Senior Data Engineer — Retrieval & RAG Platform
Senior Data Engineer — Retrieval & RAG Platform

Solvd • United States

Remote
USD 140,000 - 210,000
Machine Learning Engineer
Machine Learning Engineer

BeaconFire Inc. • New Jersey

On-site
USD 110,000 - 170,000
Senior ML Engineer - Legal AI & RAG Systems
Senior ML Engineer - Legal AI & RAG Systems

Compunnel Inc. • Raleigh (NC)

Hybrid
USD 140,000 - 210,000
Generative AI Engineer
Generative AI Engineer

Harnham • United States

On-site
USD 150,000 - 230,000
Senior AI Data Engineer (RAG / Retrieval / Python)
Senior AI Data Engineer (RAG / Retrieval / Python)

Insoftex • United States

Remote
USD 120,000 - 180,000
Senior GenAI Engineer: Build Scalable AI Platform on AWS
Senior GenAI Engineer: Build Scalable AI Platform on AWS

Compunnel Inc. • Los Angeles (CA)

On-site
USD 120,000 - 160,000
AI Development Lead
AI Development Lead

HRB • Indianapolis (IN)

On-site
USD 180,000 - 240,000