Databricks Platform Engineer - AI-Driven Data Products

Reply; Seattle (WA); On-site; USD 140,000 - 210,000; Full time

Job summary

Jobtailor seeks a data platform engineer to design, build, and enhance Databricks-powered capabilities for quantitative researchers. You will collaborate to evaluate new platform features, improve governance, and automate operational excellence while advancing the target-state architecture.

The role emphasizes AI-assisted coding, reusable data products, and productionizing prototypes for customers, with strong focus on security and observability.

Qualifications

• Hands-on Databricks experience across workspace, notebooks, and jobs and building platform capabilities.
• Strong Python and SQL skills are required.
• Infrastructure as Code with Terraform and modern CI/CD practices.
• Data governance and observability in managed environments (Unity Catalog, lineage, monitoring).
• Advanced workflow orchestration with Apache Airflow; Astro/Astronomer used domestically.
• Experience building reusable data products and self-service data access for researchers.
• AI-first mindset and fluency with agentic coding tools such as Claude Code.
• Full-time availability.

Responsibilities

• Design, build, and enhance platform capabilities within Databricks and related technologies.
• Evaluate and adopt emerging platform features and technologies.
• Run self-assessments and technology evaluations for research initiatives.
• Improve governance, automation, observability, security, and operational excellence.
• Help define target-state architecture for the custom platform.
• Use AI agents to design, build, test, and operate systems with proper verification.
• Build reusable platform capabilities and data products for researchers to access data.
• Accelerate prototypes to production and support Giant Tech customers on Microsoft tech.

Skills

Databricks experience

Python programming

SQL proficiency

Infrastructure as Code

CI/CD

Data governance

Observability

Airflow workflows

AI agentic tools mindset

Full-time availability

Tools

Databricks

Python

SQL

Terraform

CI/CD

Unity Catalog

Astro

Astronomer

Apache Airflow

Claude Code

Job description

Jobtailor seeks a data platform engineer to design, build, and enhance Databricks-powered capabilities for quantitative researchers. You will collaborate to evaluate new platform features, improve governance, and automate operational excellence while advancing the target-state architecture.

The role emphasizes AI-assisted coding, reusable data products, and productionizing prototypes for customers, with strong focus on security and observability.