Data Engineer

Payments Canada; Toronto; Hybrid; CAD 71,000 - 96,000; Full time

Job summary

Payments Canada is seeking a Data Engineer to design and develop data ingestion and analytical solutions. You will work with technical architects to understand data conversion requirements and build ETL/ELT processes, SQL solutions, and dashboards.

Commitment to data best practices and data literacy will be key as you participate in production support and collaborate across stakeholders. A BC/CS background and Canadian security clearance are advantageous.

Qualifications

• Minimum of three (3) years of experience in data engineering, ETL/ELT development, and database design.
• Experience with Google Cloud Platform data technologies (BigQuery, Cloud Data Storage, Data Flow).
• Eligibility to obtain and maintain Government of Canada Reliability Status Clearance and pass enhanced background checks.

Responsibilities

• Design and implement ETL/ELT data ingestion and processing pipelines.
• Create and optimize SQL queries and data models.
• Develop dashboards and reporting outputs to support business decisions.
• Collaborate with data architects and functional designers on data conversion requirements.
• Provide production support and resolve data solution issues in a timely manner.
• Lead the analysis, design, and build efforts for data storage and processing components.

Skills

SQL

Java

Python

JavaScript

Database design

Git

Education

Post-secondary IT/CS/Software Development

Tools

BigQuery

Cloud Data Storage

Data Flow

Pentaho Data Integration

Job description

What we are looking for

The Data Engineer will design and develop data ingestion and analytical solutions within Payments Canada. Reporting to the Manager, Data Analytics and BI, the Data Engineer will design and develop and unit test data solutions. In addition, the Data Engineer will be called upon to provide production support and resolve issues that may arise running data solutions.

The Data Engineer will be called upon to work with technical architects and functional designers to understand data conversion requirements and design the conversion procedures and applications for new and legacy systems that underpin the Canadian economy. Additionally, the Data Engineer will apply proven communication, analytical, and problem-solving skills to help the business make good technology decisions as it relates to the ingestion, processing and storage of data.

Duties and Responsibilities of the Data Engineer position will include but is not limited to:

Modeling and design of new warehousing data structures

• Thorough understanding of the data lake/data warehouse solutions being built.
• Key player on data lake data warehouse solution development.
• Design and develop ETL/ELT solutions for Modernization data.
• Design and develop SQL solutions.
• Design and develop dashboards and reporting outputs.
• Understand the data landscape of source systems.
• Design data lakes, data warehouses to hold and serve data (Data Modeling).
• Design and develop data ingestion ETL/ELT processes.
• Design and develop dashboards and other reporting outputs.
• Leading the analysis, design, and build efforts for all data storage and processing components being custom built or reused.

Stakeholder communications

• Advocate on data best practices.
• Champion on organization data literacy.

Production support

• Participate in monitoring production systems.
• Research and diagnose failures and issues in a timely manner.
• Provide suggestions and solutions to resolve problems.

Technical Competencies

• Strong expertise in SQL
• Knowledge of Google Cloud Platform data technologies (BigQuery, Cloud Data Storage, Data Flow)
• Knowledge of Pentaho data tools including Pentaho Data Integration.
• Proficiency in at least 2 programming languages (javascript, java, python, etc)
• Proficiency in database design and architecture.
• Knowledge of source code management principles and experience with GIT

Personal Competencies

• Social and self-awareness
• Ability to convey complex technical concepts into business terms
• Excellent written, verbal communication and presentation skills
• Ability to develop and maintain effective working relationships
• Sound judgment, initiative and flexibility
• Strong attention to detail and quality
• Team player; strong sense of responsibility in taking ownership

What you need to be successful

• Post-secondary education in Information Technology, Computer Science, Software Development.
• Minimum of three (3) years of experience in data engineering, ETL/ELT development, Database Design.
• Experience in Google Cloud Platform data technologies (BigQuery, Cloud Data Storage, Data Flow).
• Eligibility to obtain and maintain a Government of Canada Reliability Status Clearance and can successfully complete enhanced background checks that may be carried out by Payments Canada.

You will really stand out with

• Experience or understanding of Machine Learning techniques.
• GCP certification.

Salary range

Our target starting rate for this role is$83,300with flexibility based on your experience and qualifications. The full salary range and benefits package are detailed below.