Senior Azure Cloud Data Engineer - ADF, Databricks & PySpark

Wipro Limited

Toronto

On-site

CAD 83,000 - 96,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Wipro Limited is seeking a Senior/Lead Azure Cloud Data Engineer to design, develop, and optimize large-scale cloud-based data solutions on Microsoft Azure. The candidate will build scalable pipelines using Azure Data Factory, Databricks, PySpark, and Autosys, collaborating with stakeholders to meet analytics, regulatory, and operational needs.

The role focuses on data ingestion, transformation, and quality frameworks, ensuring robust ETL/ELT processes while optimizing Spark performance and cost

Qualifications

  • Bachelor’s or Master’s degree in CS/IT/Engineering or related field.
  • 10+ years of experience in Data Engineering and Data Warehousing.
  • 5+ years of experience with Azure Data Platform technologies.
  • Strong hands-on experience with Azure Data Factory, Databricks, ADLS, MySQL, PySpark, SQL, Autosys.
  • Experience designing and implementing ETL/ELT frameworks; distributed computing knowledge.

Responsibilities

  • Design, develop, and maintain scalable data ingestion and transformation pipelines using Azure Data Factory.
  • Build and optimize data processing solutions using Azure Databricks and PySpark.
  • Develop and maintain batch and near real-time data integration workflows.
  • Implement data quality, validation, reconciliation, and monitoring frameworks.
  • Schedule, monitor, and troubleshoot jobs using Autosys and cloud-native tools.
  • Design and implement robust ETL/ELT solutions leveraging Azure services.

Skills

Azure Data Factory
Azure Databricks
PySpark
Autosys
Python
SQL
Data Engineering
Data Warehousing

Education

Bachelor’s or Master’s in Computer Science/IT/Engineering

Tools

Azure Data Factory
Azure Databricks
ADLS
MYSQL
Git/Azure DevOps

Job description

Wipro Limited is seeking a Senior/Lead Azure Cloud Data Engineer to design, develop, and optimize large-scale cloud-based data solutions on Microsoft Azure. The candidate will build scalable pipelines using Azure Data Factory, Databricks, PySpark, and Autosys, collaborating with stakeholders to meet analytics, regulatory, and operational needs.

The role focuses on data ingestion, transformation, and quality frameworks, ensuring robust ETL/ELT processes while optimizing Spark performance and cost

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior/Lead Azure Cloud Data Engineer
Senior/Lead Azure Cloud Data Engineer

Wipro Limited • Toronto

On-site
CAD 83,000 - 96,000
Azure Cloud Data Engineer
Azure Cloud Data Engineer

Compunnel Inc. • Mississauga

On-site
CAD 100,000 - 130,000
Databricks Engineer
Databricks Engineer

Compunnel Inc. • Mississauga

On-site
CAD 120,000 - 150,000
Senior Data Engineer - Big Data & Spark Expert
Senior Data Engineer - Big Data & Spark Expert

Wipro Ltd. • Mississauga

On-site
CAD 100,000 - 150,000
Azure Data Engineer (Onsite – Windsor, ON)
Azure Data Engineer (Onsite – Windsor, ON)

Spait Infotech • Windsor

On-site
CAD 85,000 - 110,000
Azure Data Engineer
Azure Data Engineer

Astra-North Infoteck Inc. • Toronto

Hybrid
CAD 120,000 - 170,000
Remote Azure Data Architect: Cloud Data Pipelines
Remote Azure Data Architect: Cloud Data Pipelines

Source Code • Toronto

Hybrid
CAD 120,000 - 160,000
Databricks Engineer - Azure Data Pipelines & Lakehouse
Databricks Engineer - Azure Data Pipelines & Lakehouse

Compunnel Inc. • Mississauga

On-site
CAD 120,000 - 150,000
Databricks Architect
Databricks Architect

Acunor • Canada

On-site
CAD 100,000 - 130,000
Azure Data Platform Engineer – Databricks & Delta Lake
Azure Data Platform Engineer – Databricks & Delta Lake

Compunnel Inc. • Mississauga

On-site
CAD 100,000 - 130,000