Senior Data Engineer

CG Consulting Group; St. Thomas; Hybrid; CAD 80,000 - 120,000; Full time

Job summary

An established industry player seeks a Senior Data Engineer to join their dynamic team. In this role, you will leverage your extensive experience in data integration and database development to design and implement robust data pipelines. You will work in a hybrid environment, collaborating with cross-functional teams to deliver innovative solutions in the financial services sector. This position offers the opportunity to lead projects, mentor junior team members, and engage with cutting-edge technologies. If you are passionate about data engineering and thrive in a fast-paced environment, this role is perfect for you.

Qualifications

• 8+ years of IT experience in complex projects, strong in data integration.
• Bachelor's degree required, with a focus on data analysis and database development.

Responsibilities

• Design data integration solutions and develop high-performing data pipelines.
• Lead and mentor the technical team while ensuring compliance with standards.

Skills

Data Analysis

Database Development

Data Integration Methodologies

Communication Skills

Data Warehousing Life Cycle

Problem Solving

Education

Bachelor's Degree in Computer Science

Tools

Microsoft SSIS

Azure Data Factory

Databricks

Informatica

Microsoft Power BI

Job description

Senior Data Engineer

Client is a Toronto-based IT consulting boutique that strives for excellence in customer service and delivery in financial services and fintech industry. They focus on technology advisory services, application development, cloud computing, integration solutions, and enterprise big data and analytics. With a team of highly knowledgeable business and technical experts, we provide strategic, mission-critical solutions to our clients.

Looking for a senior Data Engineer who has hands-on experience in data integration and database development in a hybrid environment and who will contribute to successfully deliver hybrid data integration or custom database development projects in the Greater Toronto Area.

Company location: Downtown Toronto,
Hybrid work environment: mix of home, office and client site
Perm / FTE role: Salary: Market rate + benefits and performance bonus

RESPONSIBILITIES

1. Understand business requirements for data and information especially in the financial services industry.
2. Responsible for overall design of the data integration solution or data pipeline strategy for client engagements based on an approach that is holistic, scalable, pragmatic, and effective design of data processing.
3. Work with Data Architect on the overall design fulfilling the data and business requirements.
4. Develop high performing data pipelines in Microsoft SSIS, Azure Data Factory, or Databricks.
5. Develop database stored procedures based on Microsoft T-SQL and/or Oracle PL/SQL.
6. Develop data processing modules in one of these programming languages: C#, Java, Python.
7. Perform data profiling and data quality audit.
8. Design automated unit-testing framework as per project requirement.
9. Integrate pipelines with Continuous Integration/Delivery framework as needed.
10. Produce estimates for analysis, design, development, and testing for data pipelines.
11. Lead, mentor, and coach the technical team on client engagements.
12. Assist with proposals and pre-sales activities.
13. Lead development to our best practices in data integration and data engineering.
14. Ensure compliance with business, data, and technical requirements.
15. Ensure that client’s enterprise architecture standards, policies, and procedures are followed.

REQUIREMENTS

1. Minimum Bachelor’s degree in Computer Science or Engineering.
2. Minimum 8 years experience in Information Technology, participating in complex projects.
3. Strong communication skills.
4. Strong knowledge in data analysis, database development, data warehousing life cycle and data integration methodologies (ETL, ELT, EAI, EII).
5. Strong knowledge and extensive experience using Microsoft SSIS or Informatica.
6. Strong SQL knowledge in Microsoft SQL Server or Oracle databases and its languages: T-SQL, PL/SQL.
7. Working knowledge in one or more of the following languages: Java, C#, Python, Bash, PowerShell.
8. Familiar with capabilities of various platform services (e.g. Compute, Storage, Web, Developer, Integration, Data, Security, or Management) from the cloud vendors.
9. Working knowledge of Azure Data Factory.
10. Working knowledge of one of data analytics tools (such as Microsoft Power BI).
11. Knowledgeable in both relational and dimensional data modeling (with both Kimball and Inmon approaches).
12. Knowledge in data management, REST-oriented API, Continuous Integration and Delivery (CI/CD) principles.
13. Good overall business knowledge in financial industries (i.e. one or more in retail banking, commercial banking, capital markets, wealth management, insurance, pension fund, and fintech).
14. Preferably exposures to Hadoop ecosystem data tools (e.g. Hive, Hbase, Nifi, Spark).
15. Ability to work independently and excel in a team environment.