Remote Lead Databricks ML & AI Ops Engineer

KData Inc.; United States; Remote; USD 180,000 - 240,000; Full time

Job summary

KData Inc. seeks a Lead Databricks ML & AI Ops Engineer to architect, scale, and govern the ML/AI platforms powering our enterprise data products.

You will define the technical vision for end-to-end MLOps on Databricks, Delta Lake, and Unity Catalog. As the primary technical authority, you will lead a team of senior engineers, collaborate with data science leadership, and align with product teams to deliver robust AI features.

Qualifications

• 8+ years of software, data, or DevOps engineering experience, with 5+ years in production ML/AI systems.
• Deep knowledge of the Databricks ecosystem: Workflows, Unity Catalog, Delta Live Tables.

Responsibilities

• Define the architectural roadmap for the enterprise ML platform.
• Establish engineering standards for CI/CD, testing, and governance.
• Lead, mentor, and coach senior engineers.
• Engage with Databricks account teams and represent the company at events.
• Architect reusable batch and streaming feature pipelines with Delta Live Tables and Spark Structured Streaming.
• Standardize cluster configurations for cost and performance optimization.

Skills

Databricks expertise

Distributed systems

Python

DevOps / GitOps

Cloud platforms

Kubernetes

Spark internals

MLOps

Tools

Databricks Workflows

Delta Live Tables

Unity Catalog

MLflow

LangChain

Mosaic AI

Job description

KData Inc. seeks a Lead Databricks ML & AI Ops Engineer to architect, scale, and govern the ML/AI platforms powering our enterprise data products.

You will define the technical vision for end-to-end MLOps on Databricks, Delta Lake, and Unity Catalog. As the primary technical authority, you will lead a team of senior engineers, collaborate with data science leadership, and align with product teams to deliver robust AI features.