Data Engineer: Build Scalable Pipelines in Azure & Spark

Cpus Engineering Staffing Solutions Inc.; Oshawa; On-site; CAD 80,000 - 100,000; Full time

Job summary

A staffing solutions company is seeking a Data Engineer to develop and support data-driven applications. Responsibilities include building scalable data pipelines, ensuring secure data management, and collaborating with cross-functional teams. Ideal candidates will have a four-year degree in computer science or a related field, strong skills in Python and SQL, and experience with Azure tools. Join a diverse team dedicated to inclusivity in a progressive work environment.

Qualifications

• Completion of a four-year University education in computer science, data engineering, or related fields.
• Experience in building data pipelines.
• Fluent in Python, PySpark, SparkSQL, and SQL.

Responsibilities

• Build and productionize modular and scalable data ELT/ETL pipelines.
• Implement data ingestion and curation data pipelines.
• Collaborate with data architect and business analysts.

Skills

Data pipeline development

Python

PySpark

SQL

Azure Data Factory

Data Lakehouses

Data Warehousing

Effective communication

Education

Four-year degree in Computer Science or related field

Tools

Azure SQL Databases

Azure Synapse Analytics

Azure Databricks

Power BI

Job description

A staffing solutions company is seeking a Data Engineer to develop and support data-driven applications. Responsibilities include building scalable data pipelines, ensuring secure data management, and collaborating with cross-functional teams. Ideal candidates will have a four-year degree in computer science or a related field, strong skills in Python and SQL, and experience with Azure tools. Join a diverse team dedicated to inclusivity in a progressive work environment.