Data Engineer - Azure Databricks

Capgemini; Toronto; On-site; CAD 85,000 - 120,000; Full time

Job summary

A leading company, Capgemini, is seeking a Data Engineer specializing in Azure Databricks to design and implement scalable data pipelines. This role involves collaborating with stakeholders, developing ETL processes, and optimizing workflows to enhance performance. Candidates should have strong skills in SQL and Python, alongside knowledge of Microsoft Fabric tools.

Benefits

Flexible work

Healthcare

Paid time off

Parental leave

Family building benefits

Social well-being benefits

Mentoring

Qualifications

• Proficiency in SQL and Python for data modeling and querying within Microsoft Fabric.
• Experience with Databricks and Microsoft Fabric components is essential.
• Understanding of ETL development and data transformation processes.

Responsibilities

• Design and implement scalable data pipelines and transformations using Databricks.
• Optimize big data processing workflows to enhance performance.
• Ensure data security and compliance with regulations.

Skills

SQL

Python

Databricks

Azure

ETL development

Tools

Azure Data Factory

PySpark

Spark SQL

Job description

Join to apply for the Data Engineer - Azure Databricks role at Capgemini.

Job Title: Azure Data Engineer working 3 days in North York, Ontario

Job Description:

• Design and implement scalable data pipelines and transformations primarily using Databricks. Experience with Microsoft Fabric tools such as Azure Data Factory, PySpark notebooks, Spark SQL, and Python is a plus.
• Develop ETL processes to extract, transform, and load data from diverse sources into data warehouses or analytical systems within Databricks.
• Optimize big data processing workflows to enhance performance and efficiency using Databricks capabilities.
• Ensure data security and compliance with data privacy regulations throughout the data engineering process.
• Collaborate with stakeholders to gather requirements and create technical solutions using Microsoft Fabric.

Key Skills:

• Proficiency in SQL and Python for data modeling and querying within Microsoft Fabric.
• Experience with Databricks and Microsoft Fabric components like Azure Synapse, Data Lake, and Databricks.
• Knowledge of data warehousing and data governance within the Fabric ecosystem.
• Understanding of ETL development and data transformation processes using Fabric tools.
• Familiarity with cloud-based data engineering solutions, particularly Azure.

Life at Capgemini: Capgemini supports all aspects of your well-being throughout your career. Benefits include flexible work, healthcare, paid time off, parental leave, family building benefits, social well-being benefits, mentoring, employee resource groups, and disaster relief.

About Capgemini: A global leader in business and technology transformation, helping organizations accelerate their transition to a digital and sustainable world. With over 55 years of heritage, 340,000 employees in more than 50 countries, and €22.1 billion in revenue, Capgemini leverages AI, cloud, data, and industry expertise to deliver end-to-end solutions.

Disclaimer: Capgemini is an Equal Opportunity Employer. All qualified applicants will receive consideration without regard to race, gender, age, religion, disability, or other protected characteristics. Reasonable accommodations are provided during recruitment. For more info, visit here.

This is a general description of duties, responsibilities, and qualifications. Capgemini may consider reasonable accommodations for individuals with disabilities during the recruitment process.

Additional Details:

• Job: Programmer/Analyst
• Schedule: Full-time
• Location: CA-ON-Toronto
• Organization: I&D