Data Integration Specialist

Q1 Technologies, Inc.; Mississauga; On-site; CAD 55,000 - 65,000; Full time

Job summary

An established industry player is seeking a Data Integration Specialist to design and develop ETL processes that transform and manage data from diverse sources. This role involves optimizing data pipelines, ensuring data quality, and creating insightful visualizations. The ideal candidate will have extensive experience with Azure Data Factory, SQL, and Python, and will thrive in a collaborative environment. Join a forward-thinking company that values innovation and offers opportunities for professional growth in the dynamic field of data management.

Qualifications

• 5+ years in Enterprise Data Management with a focus on ETL processes.
• Proficiency in SQL and Python for data manipulation and analysis.

Responsibilities

• Design and implement ETL workflows for data extraction and loading.
• Manage ETL pipelines to ensure data integrity and quality.

Skills

Enterprise Data Management

Azure Data Factory

Databricks

SQL Server Development

Data Architecture

Finance/Banking Industry Knowledge

Python Coding

Power BI

Snowflake Utilities

Cloud Data Architectures

Tools

SnowSQL

SnowPipe

ETL Tools

Job description

Get AI-powered advice on this job and more exclusive features.

Direct message the job poster from Q1 Technologies, Inc.

• Design and Develop ETL Processes: Architect and implement ETL workflows to extract data from diverse sources, transform it into a usable format, and load it into a data warehouse or data mart.
• Data Pipeline Management: Manage and maintain the ETL pipelines, ensuring data integrity and consistency. Leverage SQL, programming language (Python or similar) and/or ETL Tools (Azure Data Factory, Data Bricks, Talend, SnowSQL and SnowPipe) to develop data pipeline solutions to ingest and exploit new and existing data sources.
• Database Design and Management: Design and manage database structures, including tables, views, and indexes, to support ETL processes. Experience designing and developing Enterprise Data Warehouse solutions.
• Data Modeling: Develop and maintain data models to ensure data quality and consistency within the BI system. Proficient writing SQL and Python queries and programming including stored procedures and reverse engineering existing process.
• Data Visualization:Create clear and concise visualizations (charts, graphs, dashboards) to communicate data insights effectively.
• Documentation: ability to create well documented tech specs and user guides of existing dashboards.
• Data Quality Assurance: Implement data quality checks and validation processes to ensure the accuracy and reliability of the transformed data.
• Performance Tuning: Optimize ETL processes for performance, scalability, and efficiency.
• Scheduling: Setting up Tidal jobs.

Skills:

• 5+ years - Enterprise Data Management
• Expertise in developing and maintaining Azure data factory pipelines.
• 2+ years of hands-on experience with Databricks.
• 5+ years - SQL Server based development of large datasets
• 3+ years with Data Architecture
• 3+ years’ experience in Finance / Banking industry – some understanding of Securities and Banking products and their data footprints
• 3+ years Python coding experience.
• Proficient with Power BI or other data visualization tools
• Hands-on experience with Snowflake utilities such as SnowSQL and SnowPipe
• Working knowledge of MS Azure configuration items with respect to Snowflake.
• Hands-on experience with Tasks, Streams, Time travel, Optimizer, Metadata Manager, data sharing
• Experience in Data warehousing - OLTP, OLAP, Dimensions, Facts, and Data modeling
• Previous experience contributing to an enterprise-wide Cloud Data Platform migration
• Experience with Cloud based data architectures, messaging, analytics

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Q1 Technologies, Inc. by 2x

Get notified about new Data Integration Specialist jobs in Mississauga, Ontario, Canada.

Toronto, Ontario, Canada CA$55,000.00-CA$65,000.00 22 hours ago

Technology - Reactivate Your Career Program, Full-Time, Mississauga – Canada, 2025

Associate Data Analyst (8 month-contract) (CA)

Mississauga, Ontario, Canada CA$97,000.00-CA$97,000.00 2 weeks ago

Business System Analyst – Reference Data(Cap Markets)

Toronto, Ontario, Canada CA$125,000.00-CA$135,000.00 2 weeks ago

Meter Data Management Analyst (1-Year Contract)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.