Senior ML Engineer — Cloud Data & AI Platform Lead

United States Digital Space LLC; Mississauga; On-site; CAD 146,000 - 174,000; Full time

Benefits offered by this job

Paid time off

Medical, dental, and vision coverage

Retirement savings plans

Life and disability insurance

Employee assistance programs

Job summary

United States Digital Space LLC in Canada seeks an experienced data engineering leader to design and manage data pipelines using Azure Data Factory and Databricks. You will assemble large datasets to support analytics and collaborate with executives, product, and design teams to optimize data infrastructure.

Responsibilities include leading 10-15 team members, building ETL infrastructure with SQL and Azure big data technologies, and delivering clear presentations to stakeholders.

Qualifications

• Creates and maintains data pipelines using Azure Data Factory, with Spark-based ETL on Databricks.
• Assembles large, complex data sets meeting functional/non-functional business requirements.
• Builds infrastructure for optimal extraction, transformation, and loading of data from varied sources using SQL and Azure big data tech.
• Collaborates with Executive, Product, Data and Design teams to support data infrastructure needs.
• Develops data tools for analytics and data science teams to drive product leadership.
• Works with analytics experts to enhance data system functionality.
• Leads a team of 10-15 members.
• Strong presentation and communication skills.

Responsibilities

• Create and maintain optimal data pipeline architecture using ADF.
• ETL through Azure Databricks; strong Spark understanding.
• Assemble large, complex data sets meeting business requirements.
• Build infrastructure for ETL using SQL and Azure big data technologies.
• Collaborate with stakeholders to support data infrastructure needs.
• Create data tools for analytics and data science teams.
• Work with analytics experts to improve data systems.
• Lead 10-15 team members.
• Present and communicate effectively to stakeholders.

Skills

Azure Data Factory

Azure Databricks

Azure Machine Learning

PySpark

SQL

Python

Power BI

AWS

Salesforce

DevOps

Azure Security

Tools

Spark

Job description

United States Digital Space LLC in Canada seeks an experienced data engineering leader to design and manage data pipelines using Azure Data Factory and Databricks. You will assemble large datasets to support analytics and collaborate with executives, product, and design teams to optimize data infrastructure.

Responsibilities include leading 10-15 team members, building ETL infrastructure with SQL and Azure big data technologies, and delivering clear presentations to stakeholders.