Data Engineer

Astek; Toronto; On-site; CAD 80,000 - 110,000; Full time

Job summary

Join a forward-thinking technology consulting firm as a Data Engineer, where you'll be at the forefront of innovation in the banking sector. This role offers the chance to design and implement secure data processing pipelines using cutting-edge Azure technologies, while collaborating with a dynamic team to tackle complex data challenges. Your expertise will drive improvements in data workflows, ensuring compliance and enhancing data quality. If you're passionate about leveraging data to unlock insights and improve business performance, this opportunity is perfect for you. Embrace the challenge and contribute to a culture of equity, diversity, and inclusion.

Benefits

Personalized CARE plan

Diversity & Inclusion Charter

Qualifications

• 8+ years of experience with Microsoft Azure technologies.
• Experience in building and maintaining secure data processing pipelines.

Responsibilities

• Design, build, and maintain data processing pipelines using Azure services.
• Collaborate with teams to understand data needs and create effective workflows.

Skills

Microsoft Azure

Data Processing Pipelines

ETL Operations

Data Migration

Data Validation

Data Analysis

Education

Bachelor's Degree in Computer Science or related field

8+ years experience with Microsoft Azure technologies

Tools

Azure Databricks

Azure Data Factory

Azure SQL Database

Azure Data Lake

PySpark

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Astek

Astek is a global leader in technology consulting. With 9,600 experts worldwide, we guide our clients through digital transformation by developing innovative solutions.

In Canada, we excel in IT and engineering. We collaborate with leading companies to tackle major technological challenges, putting innovation, collaboration, and excellence at the heart of our actions.

Join a passionate and committed team ready to bring your ideas to life.

About the Role

On behalf of our client in the Banking industry, Astek Canada is seeking a motivated Data Engineer ready to take on new challenges.

Your Responsibilities

As a Data Engineer, you will be responsible for:

• Work together with other data engineers, data analysts, business analysts, business SME’s, records analyst, and privacy analyst to understand the needs for data and create effective, secure data workflows.
• Responsible for designing, building, and maintaining secure and compliant data processing pipelines using various Microsoft Azure data services and frameworks including but not limited to Azure Databricks, Data factory, ADLS Storage, PySpark.
• Build databases, data marts or data warehouse and perform data migration work.
• Build reporting and analytical tools to utilize the data pipeline, provide actionable insight into key business performance metrics.
• Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Microsoft Azure Cloud.
• Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and/or Azure Blob Storage.
• Utilize Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.
• Implement data validation and cleansing procedures to ensure the quality, integrity, and dependability of the data.
• Improve the scalability, efficiency, and cost-effectiveness of data pipelines.
• Monitor and resolve data pipeline problems to ensure consistency and availability of the data.
• Identify, design, and implement internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Adapt and learn new technologies per business requirements.
• Ensure compliance with data governance, privacy and security policies.
• Fosters and maintains an organizational culture that promotes equity, diversity and inclusion, mutual respect, teamwork, and service excellence.

Your Qualifications

Education/Experience:

• Architectures, and datasets using Microsoft Azure technologies including Spark. - 8 years minimum.
• Experience with data migration projects within Microsoft and Azure - 8 years minimum.

Key Skills:

• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with unstructured datasets.
• A successful history of manipulating, processing, and extracting value from large, disconnected datasets.
• Ability to plan, prioritize and manage workload within a time sensitive environment.

Personal Qualities:

• Analytical and solution-oriented mindset.
• Team collaboration and teamwork skills.
• Autonomy and rigor in managing priorities.

The Astek Advantages

• Personalized CARE plan for our employees.
• Diversity & Inclusion Charter.

Ready to Take on the Challenge?

Apply now by sending your CV and discover a rewarding career at Astek Canada.

Seniority level

• Seniority level

  Associate

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Astek by 2x

Sign in to set job alerts for “Data Engineer” roles.

Software Engineer, Backend (All Levels / All Teams)

Software Engineer I, Entry Level (Fall 2024-Spring 2025) - Toronto

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.