Senior Data Engineer - Azure Data Factory & Databricks

Jobgether; Remote; USD 185,000 - 200,000; Full time

Job summary

A recruitment agency is seeking an experienced Data Engineer to construct robust data pipelines essential for internal analytics. In this role, you will collaborate with senior engineers to ensure seamless data ingestion from various sources and maintain high data quality for analysis. Key responsibilities include building Azure Data Factory pipelines, writing Python code in Databricks, and automated data integrity checks. A comprehensive benefits package is offered along with a competitive starting salary range between $185,000 and $200,000, based on experience.

Benefits

Medical, dental, and vision coverage

Paid time off

Tuition reimbursement

Employee discounts

Registered Retirement Savings Plan (RRSP)

Qualifications

• 5+ years of experience in Data Engineering, focusing on ETL/ELT.
• Strong proficiency in SQL for data analysis.
• Experience with data schemas and APIs from platforms like Microsoft Dynamics, Salesforce.

Responsibilities

• Build and maintain Azure Data Factory pipelines.
• Write Python code to clean raw data.
• Monitor daily jobs and troubleshoot pipeline failures.

Skills

Data Engineering

ETL/ELT pipelines

SQL

Python

Azure Data Factory

Databricks

Automated data quality checks

Education

Bachelor’s degree in Computer Science, Software Engineering, Data Engineering or related field

Tools

Azure Data Factory

Databricks

Job description

A recruitment agency is seeking an experienced Data Engineer to construct robust data pipelines essential for internal analytics. In this role, you will collaborate with senior engineers to ensure seamless data ingestion from various sources and maintain high data quality for analysis. Key responsibilities include building Azure Data Factory pipelines, writing Python code in Databricks, and automated data integrity checks. A comprehensive benefits package is offered along with a competitive starting salary range between $185,000 and $200,000, based on experience.