Hybrid Senior AI Engineer — Engineering Intelligence Platform

Mission.dev; San Francisco (CA); Hybrid; USD 150,000 - 200,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

401(k) retirement plan

Paid parental leave

14 paid holidays

Unlimited vacation

Flexible working hours

Job summary

Mission.dev is seeking an experienced Senior Data Engineer to build a comprehensive engineering intelligence platform. You will own the end-to-end data architecture, merging telemetry with commercial metrics to create a single source of truth and accelerate development velocity.

You will drive AI enablement across the engineering organization by designing and shipping LLM-powered agents and productivity tools, including code search assistants and runbook copilots, using RAG and modern lakehouse

Qualifications

• 8+ years of experience in application development and distributed systems architecture.
• 5+ years of production data engineering experience building ETL/ELT workflows and analytics platforms.
• Expert proficiency in Spark, PySpark, and SQL for large-scale data processing and performance tuning.
• Strong Python programming skills and extensive experience with dimensional modeling.
• Proven experience shipping LLM-powered applications, including production RAG systems or AI agents.
• Deep expertise in modern lakehouse architectures and medallion data structures.
• Professional background in eCommerce or similar transactional and operational data domains

Responsibilities

• Develop production ETL/ELT pipelines and dimensional models to transform raw eCommerce and observability data into an analytics-ready state.
• Construct summarized datasets and aggregation layers to support natural-language querying and executive-level reporting.
• Engineer a unified health dashboard that integrates system latency and error signals with commercial metrics like conversion and renewal rates.
• Standardize and surface engineering performance metrics, including delivery velocity, security posture, and incident trends.
• Build and deploy AI agents for automated anomaly detection, incident triage, and intelligent root-cause analysis.
• Design and implement LLM-powered productivity tools, including code search assistants and runbook copilots, using RAG and prompt engineering.
• Utilize modern lakehouse platforms to deliver internal tools, chatbots, and operational applications directly to stakeholders.
• Collaborate with cross-functional teams to identify automation opportunities and evangelize AI adoption across the engineering organization.

Skills

Distributed systems

Data engineering

Spark

PySpark

SQL

Python

LLM / AI agents

Lakehouse

Ecommerce domain

Tools

RAG

Job description

Mission.dev is seeking an experienced Senior Data Engineer to build a comprehensive engineering intelligence platform. You will own the end-to-end data architecture, merging telemetry with commercial metrics to create a single source of truth and accelerate development velocity.

You will drive AI enablement across the engineering organization by designing and shipping LLM-powered agents and productivity tools, including code search assistants and runbook copilots, using RAG and modern lakehouse