Lead Data Engineer

Jobgether; Remote; USD 185,000 - 200,000; Full time

Job summary

A recruitment agency is seeking an experienced Data Engineer to construct robust data pipelines essential for internal analytics. In this role, you will collaborate with senior engineers to ensure seamless data ingestion from various sources and maintain high data quality for analysis. Key responsibilities include building Azure Data Factory pipelines, writing Python code in Databricks, and automated data integrity checks. A comprehensive benefits package is offered along with a competitive starting salary range between $185,000 and $200,000, based on experience.

Benefits

Medical, dental, and vision coverage

Paid time off

Tuition reimbursement

Employee discounts

Registered Retirement Savings Plan (RRSP)

Qualifications

• 5+ years of experience in Data Engineering, focusing on ETL/ELT.
• Strong proficiency in SQL for data analysis.
• Experience with data schemas and APIs from platforms like Microsoft Dynamics, Salesforce.

Responsibilities

• Build and maintain Azure Data Factory pipelines.
• Write Python code to clean raw data.
• Monitor daily jobs and troubleshoot pipeline failures.

Skills

Data Engineering

ETL/ELT pipelines

SQL

Python

Azure Data Factory

Databricks

Automated data quality checks

Education

Bachelor’s degree in Computer Science, Software Engineering, Data Engineering or related field

Tools

Azure Data Factory

Databricks

Job description

This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Data Engineer. In this role, you will play a crucial part in constructing robust data pipelines that serve as the backbone for internal business analytics. Collaborating closely with senior engineers, you will ensure the seamless ingestion and preparation of data from various sources, elevating data quality for analysis. Your contributions will directly influence critical decision‑making processes, providing leaders with necessary insights efficiently. This role demands a commitment to excellence, allowing you to make a real impact in a fast‑paced, results‑oriented environment.

Accountabilities

• Build and maintain Azure Data Factory pipelines to ingest data from multiple sources.
• Write Python code in Databricks to clean raw data and move it into the silver layer, handling deduplication, type casting, and validation.
• Monitor daily jobs and troubleshoot any failures to ensure pipeline stability.
• Implement automated checks to verify data integrity between source systems and the data lake.

Requirements

• 5+ years of experience in Data Engineering, with a focus on ETL/ELT pipelines in cloud environments.
• Proficiency in Azure Data Factory and Databricks for pipeline development.
• Strong proficiency in SQL for data analysis and Python for scripting.
• Experience implementing automated data quality checks and troubleshooting pipeline failures.
• Familiarity with data schemas and APIs from platforms like Microsoft Dynamics 365, Salesforce, and ServiceNow.
• Demonstrated experience using LLMs to enhance data engineering workflows.
• Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, or a related field.

Benefits

• Comprehensive benefits package including medical, dental, and vision coverage.
• Paid time off and a Registered Retirement Savings Plan (RRSP).
• Tuition reimbursement and paid parental leave.
• Access to a library of personal and professional training resources.
• Employee discounts and additional insurance coverage.
• Starting salary anticipated between $185,000 and $200,000, commensurate with experience.
• Bonus eligibility.

Why Apply Through Jobgether?

We use an AI‑powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top‑fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team.

We appreciate your interest and wish you the best!

Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre‑contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time.