Sr Data Engineer

Insight Global; Toronto; On-site; Full time

Job summary

A leading company in Health and Human Services is seeking a Data Engineer in Toronto. The role involves designing and maintaining data pipelines using Azure technologies and managing data migration projects. Candidates should have extensive experience in data engineering and strong problem-solving skills. This contract position offers competitive pay and the opportunity to work with a collaborative team.

Qualifications

• 8-10 years in Azure Data Factory, Azure Databricks, and PySpark development.
• Deep understanding of data engineering concepts and best practices.

Responsibilities

• Design, develop, and maintain data pipelines using Azure Databricks and Data Factory.
• Manage data migration projects, ensuring integrity and minimal downtime.

Skills

SQL Server

Hadoop Data Lake

Problem-Solving

Communication

Tools

Azure Data Factory

Azure Databricks

PySpark

Terraform

Job description

This range is provided by Insight Global. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$45.00/yr - $48.00/yr

Direct message the job poster from Insight Global

Responsibilities:

1. Azure Databricks & Data Factory: Design, develop, and maintain data pipelines using Azure Databricks and Data Factory.
2. Data Lake Integration: Implement solutions for data storage and retrieval in data lakes.
3. Data Migration: Manage data migration projects, ensuring integrity and minimal downtime.
4. Project Delivery: Independently deliver projects on time and meet quality standards.
5. Collaboration: Work closely with engineering and product teams to understand complex data systems.
6. Application Development: Develop scalable applications for data extraction, transformation, and loading to various storage locations.

Qualifications:

• Experience: 8-10 years in Azure Data Factory, Azure Databricks, and PySpark development.
• Skills: Proficiency in SQL Server and Hadoop Data Lake; Terraform experience is a plus.
• Analytical Skills: Ability to visualize and approach complex data problems.
• Understanding: Deep understanding of data engineering concepts and best practices.
• Data Migration: Experience with multiple data migration projects.

Additional Skills:

• Problem-Solving: Excellent problem-solving and critical thinking skills.
• Communication: Strong verbal and written communication skills.
• Customer Focus: Ability to understand customer needs and provide effective solutions.

Additional Details:

• Seniority level: Associate
• Employment type: Contract
• Industry: Health and Human Services

Referrals increase your chances of interviewing at Insight Global by 2x.

Get notified about new Data Engineer jobs in Toronto, Ontario, Canada.