Azure Data Engineer: Databricks & Data Factory | Hybrid | W2

Zohorecruit; Jersey City (NJ); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Axiom Path is leading an AI-first recruiting and staffing initiative, delivering data solutions across the financial services sector. This role focuses on building scalable ingestion, transformation, and storage pipelines in a regulated environment.

The candidate will work with Azure Data Factory, Python, SQL, and Databricks to implement Medallion Architecture, enhance a centralized metrics repository, and onboard new datasets while ensuring data quality and traceability.

Qualifications

• 5-7 years of data engineering experience.
• Proficient in Python and SQL.
• Experience with Azure Data Factory.
• Experience with Azure Databricks and Medallion Architecture.
• Knowledge of data quality controls and data governance.

Responsibilities

• Design and develop scalable data ingestion, transformation, and storage pipelines.
• Build and maintain ETL and ELT workflows using Azure Data Factory, Python, and SQL.
• Process data across Databricks Medallion Architecture layers (staging, curated, consumption-ready).
• Support the development and enhancement of a centralized metrics repository.
• Onboard new datasets ensuring accuracy, completeness, consistency and traceability.
• Optimize data storage, transformation logic, and pipeline performance for large volumes.
• Troubleshoot data issues and collaborate with stakeholders to deliver reliable data products.
• Apply data quality controls and development standards for a regulated environment.

Skills

Azure data engineering

ETL development

Python

SQL

Azure Data Factory

Azure Databricks

Medallion Architecture

Data quality controls

Tools

Azure Data Factory

Azure Databricks

SQL Server

Job description

Axiom Path is leading an AI-first recruiting and staffing initiative, delivering data solutions across the financial services sector. This role focuses on building scalable ingestion, transformation, and storage pipelines in a regulated environment.

The candidate will work with Azure Data Factory, Python, SQL, and Databricks to implement Medallion Architecture, enhance a centralized metrics repository, and onboard new datasets while ensuring data quality and traceability.