Senior ETL Developer – Azure, AWS & Databricks

ThoughtStorm Inc.; Toronto; On-site; CAD 110,000 - 160,000; Full time

Job summary

ThoughtStorm Inc. is seeking a Senior ETL Developer to design, develop, maintain, and optimize data pipelines for our Data Warehouse and BI solutions. You will work across structured, semi-structured, and relational data sources to ensure reliable data delivery.

The role requires strong SQL skills, data modeling expertise, and hands-on experience with Azure Data Factory, Databricks, and AWS data services. You will collaborate with stakeholders and contribute to documentation and best practices.

Qualifications

• Experience designing and implementing end-to-end ETL pipelines.
• Strong SQL skills including complex queries and performance tuning.
• Experience with data warehousing, data modeling and data quality processes.
• Collaborates with stakeholders to gather and validate requirements.

Responsibilities

• Design, develop, maintain, and optimize data pipelines for DW/BI solutions.
• Build and maintain ETL scheduling, job dependencies, and data cleansing.
• Prepare technical docs including mappings, data models, and design artefacts.
• Collaborate with business stakeholders to ensure scalable, high-quality data solutions.

Skills

ETL development

SQL proficiency

Data modeling

Data warehousing

Data quality

Git

Tools

Azure Data Factory

Azure SQL Database

Azure Data Lake

Power BI

Databricks Platform

AWS Glue

Amazon Aurora

OpenSearch

Git

Azure Functions

PowerShell

C#

APIs

Job description

We are seeking a Senior ETL Developer to design, develop, maintain, and optimize data pipelines supporting Data Warehouse and Business Intelligence solutions.

• Develop and maintain ETL processes for initial and daily data loads across structured, semi-structured, relational, and multidimensional data sources.
• Hands‑on experience with Azure Data Factory, Azure SQL Database, Azure Data Lake, and Power BI.
• Experience with the Databricks Platform and AWS data technologies, including AWS Glue, Amazon Aurora, and OpenSearch.
• Build and maintain ETL scheduling, job dependencies, data integration, data cleansing, and data quality processes.
• Strong expertise in complex SQL queries, performance tuning, database administration, and data modeling for data warehouses and data marts.
• Use Git and source control strategies while following software development lifecycle practices, including development, testing, QA, and delivery.
• Prepare technical documentation, including ETL source-to-target mappings, data models, architecture artifacts, and detailed design documents.
• Collaborate with business stakeholders to gather, document, and validate requirements while ensuring scalable, maintainable, and high‑quality data solutions.
• Nice to have: C#, APIs, Azure Functions, PowerShell, dashboard/report development, and knowledge of AODA standards.