Remote Azure Data Engineer — Databricks & Data Factory

Eliassen Group; Austin (TX); Remote; USD 90,000 - 103,000; Full time

Benefits offered by this job

Medical, Dental, Vision coverage

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking an Azure Data Engineer for a contract engagement to modernize an enterprise data platform by migrating workloads from on-premises Oracle/DataStage to an Azure data lake. You will design, build, and optimize scalable pipelines using Azure Databricks and Data Factory, implement data-quality checks, and promote data through Bronze, Silver, and Gold layers.

Collaborate with engineers, analysts, and stakeholders.

Qualifications

• Hands-on data engineering in enterprise environments.
• Experience with Azure Databricks and Azure Data Factory.
• Strong SQL and Python or PySpark development skills.
• Experience designing batch data pipelines and ETL/ELT workflows.
• Experience implementing data-quality, data-validation, and reconciliation processes.
• Knowledge of medallion or lakehouse architecture (Bronze/Silver/Gold).
• Experience with relational databases and large datasets.
• Understanding of data modeling, partitioning, and performance optimization.
• Experience with CI/CD and automated deployment practices.

Responsibilities

• Design, develop, test, and maintain data pipelines using Azure Databricks and Azure Data Factory.
• Support migration of data and ETL workloads to Azure cloud data lake.
• Develop scalable ingestion, transformation, and data-processing solutions.
• Design and implement medallion architecture across data layers.
• Build data-quality, reconciliation, and validation checks into pipelines.
• Automate validation and testing to improve data product reliability.
• Troubleshoot pipeline failures and performance issues.
• Collaborate with engineers, analysts, architects, and stakeholders.
• Participate in code reviews, documentation, testing, deployment, and continuous-improvement activities.
• Promote reusable development patterns and sound engineering practices.

Skills

Azure Databricks

Azure Data Factory

SQL

Python or PySpark

Data pipelines

Medallion architecture

CI/CD

Git

Azure DevOps

Tools

Git

Azure DevOps

Job description

Eliassen Group is seeking an Azure Data Engineer for a contract engagement to modernize an enterprise data platform by migrating workloads from on-premises Oracle/DataStage to an Azure data lake. You will design, build, and optimize scalable pipelines using Azure Databricks and Data Factory, implement data-quality checks, and promote data through Bronze, Silver, and Gold layers.

Collaborate with engineers, analysts, and stakeholders.