Databricks Platform Engineer (Medallion Data) - Remote

Axiom Path; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Axiom Path is seeking a senior Databricks Data Engineer to design and build enterprise-scale data solutions using a medallion architecture on Azure or AWS. You will work with architects, partners, and distributed teams to modernize data pipelines and enable AI-enabled capabilities.

You will develop reusable frameworks, ensure data quality and observability, and implement reproducible deployment through CI/CD and Git.

Qualifications

• 3+ years of Databricks experience in Azure or AWS.
• Strong SQL and PySpark programming skills.
• Experience implementing medallion architecture (Bronze/Silver/Gold).
• Ability to design reusable data engineering frameworks and pipeline components.
• Experience with CI/CD, Git-based deployment, and Agile environments.

Responsibilities

• Design, develop, and enhance enterprise-scale data solutions using Databricks and medallion architecture.
• Build reusable frameworks and common functions to standardize data ingestion, transformation, validation, repair, and pipeline monitoring.
• Develop Bronze, Silver, and Gold data layers to improve usability and accessibility of enterprise data.
• Create dimensional data structures, including facts, dimensions, derived attributes, and SCD Type 2 implementations.
• Develop and orchestrate both batch and streaming data pipelines.
• Partner with business stakeholders to translate high-level data requirements into technical solutions.
• Collaborate with architects and technical leadership on solution design and engineering standards.
• Perform hands-on development, unit testing, system integration testing, debugging, and production support.
• Build solutions that improve pipeline observability, SLA monitoring, data quality, and operational transparency.
• Optimize Databricks compute and storage performance.
• Develop documentation, training materials, and reusable guidance for other teams.
• Explore Databricks capabilities such as Intelligent Document Processing and self-service workspace features.

Skills

Databricks

SQL

PySpark

Medallion architecture

Data modeling

Data pipelines

CI/CD

Git workflows

Agile

Communication

Tools

Unity Catalog

Spark UI

Lakehouse

Job scheduling

Job description

Axiom Path is seeking a senior Databricks Data Engineer to design and build enterprise-scale data solutions using a medallion architecture on Azure or AWS. You will work with architects, partners, and distributed teams to modernize data pipelines and enable AI-enabled capabilities.

You will develop reusable frameworks, ensure data quality and observability, and implement reproducible deployment through CI/CD and Git.