Senior Data Engineer - AI-Driven Databricks Platform

PrePass; Phoenix (AZ); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Medical benefits

401(k) matching

Time off

Job summary

PrePass in the United States seeks a Senior Data Engineer to architect, build, and scale the core data platform. You will lead high‑throughput pipelines and lakehouse architectures while mentoring engineers in software craftsmanship, with a focus on TDD, XP, and AI‑augmented workflows to deliver reliable data systems in Databricks.

You will design production ETL/ELT on Azure, migrate legacy SSIS workloads to cloud‑native pipelines, ensure reliability and data quality, and help define engineering

Qualifications

• Senior data engineering experience designing, building, and operating distributed data pipelines at scale.
• Hands-on expertise with TDD for data pipelines and XP practices such as pairing and refactoring.
• Experience integrating AI-assisted tooling to accelerate delivery and testing.
• Production operations focus with strong observability and uptime expectations.

Responsibilities

• Design and implement scalable ETL/ELT pipelines on Azure for multi-source data ingestion.
• Migrate legacy SSIS workloads to cloud-native pipelines and modern architectures.
• Lead by example in clean, modular code and automated testing.
• Drive data quality, lineage, and end-to-end observability across the data platform.
• Mentor teammates and evolve engineering standards in an Agile setting.
• Collaborate to adopt AI-assisted development tools and improve CI/CD processes.

Skills

Leadership

TDD

XP practices

AI-assisted development

Observability

Mentorship

Tools

Azure Databricks

Azure Synapse

Spark

Delta Lake

CI/CD

Job description

PrePass in the United States seeks a Senior Data Engineer to architect, build, and scale the core data platform. You will lead high‑throughput pipelines and lakehouse architectures while mentoring engineers in software craftsmanship, with a focus on TDD, XP, and AI‑augmented workflows to deliver reliable data systems in Databricks.

You will design production ETL/ELT on Azure, migrate legacy SSIS workloads to cloud‑native pipelines, ensure reliability and data quality, and help define engineering