Senior Data & Analytics Engineer - Azure/Databricks

ADP; Des Peres (MO); Remote; USD 165,000 - 175,000; Full time

Job summary

Lanter Delivery Systems is seeking a Senior Data & Analytics Engineer to enhance the Azure Databricks data platform in a remote capacity. You will build and optimize ETL/ELT pipelines, develop enterprise data models, and ensure data quality across source systems and operating companies.

This hands-on role partners with analytics, governance, and business stakeholders to translate complex requirements into scalable data solutions using Python, Spark, SQL, and BI tools like Power BI or Sigma.

Qualifications

• 5+ years of experience in data engineering, analytics engineering, BI engineering, or a related field.
• Strong, hands-on experience developing production pipelines with Python and Spark/PySpark.
• Advanced SQL skills and hands-on experience with Databricks, Azure Data Lake, and Azure DevOps or comparable technologies.
• Experience designing integrated enterprise models and dimensional data marts, including grain, keys, conformed dimensions, history, and slowly changing dimensions.
• Experience implementing automated testing, regression testing, data-quality controls, and pipeline validation.
• Experience operating production data solutions, including monitoring, optimization, troubleshooting, recovery, and cost management.
• Experience with Git, code review, CI/CD, reusable development practices, and technical documentation.
• Ability to translate complex business requirements into scalable data and analytics solutions.

Responsibilities

• Build and operate ETL/ELT pipelines using Databricks, SQL, Python, Spark/PySpark, and Azure Data Lake.
• Develop an integrated enterprise gold-layer model spanning source systems, customers, and operating companies.
• Build dimensional serving-layer and data-mart models with grain, keys, conformed dimensions, historical data, and slowly changing dimensions.
• Implement automated regression testing using defined inputs and expected outputs to validate pipelines and transformations.
• Own orchestration, observability, performance, failure diagnosis, replay and recovery, root-cause fixes, and cost management for assigned production solutions.
• Partner with stakeholders to reconcile business definitions and establish data requirements, rules, ownership, and governance standards.
• Apply disciplined engineering practices, including Git, code review, reusable components, automated testing, controlled deployments, and technical documentation.
• Develop analytics and reporting solutions using Sigma, Power BI, or comparable platforms.
• Support strategic data initiatives across Lanter’s business units and industry verticals, including AI, operational visibility, and analytics enablement.
• Independently own deliverables and provide technical guidance on complex data and analytics needs.

Skills

Data engineering

Analytics engineering

BI engineering

Python

Spark/PySpark

SQL

Databricks

Azure Data Lake

Git

CI/CD

Power BI

Sigma

Tools

Databricks

Azure Data Lake

Azure DevOps

Git

Job description

Lanter Delivery Systems is seeking a Senior Data & Analytics Engineer to enhance the Azure Databricks data platform in a remote capacity. You will build and optimize ETL/ELT pipelines, develop enterprise data models, and ensure data quality across source systems and operating companies.

This hands-on role partners with analytics, governance, and business stakeholders to translate complex requirements into scalable data solutions using Python, Spark, SQL, and BI tools like Power BI or Sigma.