Data Engineer II: Production Pipelines & Reliability

TD

Toronto

On-site

CAD 82,000 - 115,000

Full time

8 hours ago

Be an early applicant

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

TD is seeking a Data Engineer to design, implement, and optimize data pipelines in Toronto, Ontario. You will work with Databricks, PySpark, and Azure data services to ensure data quality and reliable ingestion.

Key responsibilities include monitoring production pipelines, troubleshooting jobs, supporting deployments, and driving continuous improvement with DevOps, Infrastructure, and Production Support teams.

Qualifications

Degree or higher in Data Management, Computer Science, Engineering, or equivalent.
3-5 years of relevant experience.
Experience with Databricks / Spark.
Experience with Azure Data Platform (ADLS, ADF, Azure SQL).
Proficiency in Python / PySpark.
Knowledge of CI/CD and DevOps practices.
Experience with Dynatrace.
Strong stakeholder communication skills.

Responsibilities

Monitor and support production data pipelines, workflows, and platform operations.
Troubleshoot Databricks jobs, notebooks, clusters, and data processing issues.
Perform data quality investigations, reconciliations, and root cause analysis.
Manage production incidents, defects, and operational issues through resolution.
Support production deployments, PAT validation, release activities, and post-deployment validation.
Partner with DevOps, Infrastructure, and Production Support teams for stability.
Develop operational runbooks, monitoring processes, and support documentation.
Drive continuous improvement to enhance performance, resiliency, and supportability.