Senior Azure Data Engineer: Cloud Data Pipelines & Lakehouse

Eliassen Group; Santa Fe (NM); Remote; USD 103,000 - 117,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401k with match

Life insurance

Job summary

Eliassen Group is seeking a Senior Azure Data Engineer to modernize an enterprise data platform by migrating data from on-premises Oracle/DataStage to an Azure data lake. You will design, build, and optimize scalable pipelines with Databricks and Data Factory, guiding architecture decisions while delivering reliable, trusted data products.

Healthcare or finance data experience is a plus; strong Azure proficiency and medallion/lakehouse expertise are essential for delivery. Remote work supported.

Qualifications

• Extensive hands-on data engineering experience in enterprise environments.
• Proven experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python/PySpark development skills.
• Experience designing batch ETL/ELT workflows and data quality checks.
• Knowledge of medallion or lakehouse architectures Bronze-Silver-Gold.
• Experience with Git and CI/CD practices.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Migrate ETL workloads from on-premises Oracle/DataStage to Azure cloud data lake.
• Build scalable ingestion, transformation, and data-processing solutions.
• Implement medallion architecture across Bronze, Silver, Gold data layers.
• Embed data-quality checks and validation into pipelines and workflows.
• Automate validation/testing to improve data-reliability.
• Guide data-architecture decisions and engineering standards.
• Troubleshoot pipeline failures and data-quality issues.
• Collaborate with engineers, analysts, and stakeholders to translate requirements.
• Participate in code reviews, documentation, testing, deployment, and improvement.
• Promote reusable development patterns and best practices.

Skills

Azure Databricks

SQL

Python/PySpark

ETL/ELT design

Data architecture

Data quality & validation

CI/CD

Git version control

Problem solving

Tools

Azure Data Factory

Medallion architecture

Delta Lake

Git

CI/CD

Job description

Eliassen Group is seeking a Senior Azure Data Engineer to modernize an enterprise data platform by migrating data from on-premises Oracle/DataStage to an Azure data lake. You will design, build, and optimize scalable pipelines with Databricks and Data Factory, guiding architecture decisions while delivering reliable, trusted data products.

Healthcare or finance data experience is a plus; strong Azure proficiency and medallion/lakehouse expertise are essential for delivery. Remote work supported.