Senior AI Engineer - Hybrid, Scalable Data Pipelines

Mission.dev; Frisco (TX); Hybrid; USD 160.000 - 230.000; Vollzeit

Benefits dieser Stelle

Performance-based bonus

401(k) plan

Health insurance

Disability coverage

Parental leave

Holidays

Unlimited PTO

Zusammenfassung

Mission.dev is seeking a hands-on engineering leader to build a unified Engineering Intelligence Platform. You will craft scalable data pipelines, optimize Spark workloads, and deliver AI-powered tools that boost engineering productivity and incident response.

This role focuses on production data engineering, Databricks Apps, Genie, and Lakebase, with collaboration across Product, SRE, Security, and Architecture to automate workflows and adopt AI at scale.

Qualifikationen

• 8+ years of application development and distributed systems experience.
• 5+ years of hands-on production Data Engineering experience.
• Expert Spark/PySpark skills, including performance tuning at scale, Spark SQL, partitioning, and shuffle handling.
• Expert SQL, strong Python, and experience with dimensional modeling and large-scale data pipelines.
• Experience with modern lakehouse architectures, including Delta Lake and Medallion Architecture; Databricks expertise strongly preferred.
• Hands-on experience deploying production AI agents, with the ability to explain their architecture, tool use, evaluation, and failure handling.
• Experience shipping LLM-powered applications using techniques such as RAG, tool calling, guardrails, and evaluation.
• Hands-on Databricks application development experience; familiarity with Databricks Apps, Genie, and Lakebase is highly relevant.
• Experience in eCommerce or similar transactional domains, such as payments, subscriptions, or renewals.
• Regular use of AI coding assistants such as Claude or GitHub Copilot to accelerate development.

Aufgaben

• Build and maintain production ETL/ELT pipelines integrating eCommerce, observability, and operational data.
• Develop and optimize Spark/PySpark jobs at scale, including Spark SQL, partitioning, and shuffle performance.
• Design dimensional models and aggregated gold-layer datasets for analytics, dashboards, and natural‑language querying.
• Build a unified eCommerce Health dashboard combining system performance, incident trends, conversion, checkout, and subscription metrics.
• Develop and deploy production AI agents for anomaly detection, incident triage, and root‑cause analysis.
• Build LLM‑powered engineering tools, including intelligent search, RCA assistants, and runbook copilots.
• Develop internal applications and AI‑powered experiences using Databricks Apps, Genie, and Lakebase.
• Partner with Product, SRE, Security, and Architecture teams to automate workflows and drive AI adoption.

Jobbeschreibung

Mission.dev is seeking a hands-on engineering leader to build a unified Engineering Intelligence Platform. You will craft scalable data pipelines, optimize Spark workloads, and deliver AI-powered tools that boost engineering productivity and incident response.

This role focuses on production data engineering, Databricks Apps, Genie, and Lakebase, with collaboration across Product, SRE, Security, and Architecture to automate workflows and adopt AI at scale.