Data DevOps Engineer

HSBC; Toronto; On-site; CAD 110,000 - 145,000; Full time

Job summary

HSBC in Toronto is seeking a Data DevOps Engineer to join the CTO Analytics Technology team. You will help optimize data workflows across multi‑cloud environments and collaborate with data scientists and engineers to deliver scalable data platforms.

Key responsibilities include building and maintaining data pipelines with Hadoop, BigQuery, EMR, Snowflake, Databricks; implementing ML workflows with Airflow, MLflow and Vertex AI; and deploying Python applications and APIs.

Qualifications

• Bachelor's degree in CS or related field or equivalent practical experience.
• Familiarity with Hadoop, HDFS, BigQuery, EMR, Snowflake and Databricks.
• Experience with JupyterHub, MLflow, Vertex AI, Dataproc, Dataflow and Airflow.
• Proficiency in Python including API/app development.
• Knowledge of Linux and cloud platforms (GCP/AWS/Azure).
• Understanding of Kubernetes, MLOps/LLMOps and LLMs is a plus.

Responsibilities

• Assist in development, deployment, and maintenance of data pipelines.
• Support data science initiatives with tools like JupyterHub and Vertex AI.
• Collaborate with data scientists to implement ML models and workflows.
• Develop Python applications and APIs to support data workflows.
• Monitor data pipelines for quality and reliability, troubleshoot as needed.
• Participate in ML model deployment, including MLOps/LLMOps practices.
• Work with Kubernetes to deploy apps in cloud environments.
• Stay updated on data engineering, DevOps and cloud trends.

Skills

Python programming

APIs development

Collaboration

Education

Bachelor's degree in Computer Science or related field

Tools

Hadoop

HDFS

BigQuery

EMR

Snowflake

Databricks

JupyterHub

MLflow

Vertex AI

Dataproc

Dataflow

Airflow

pandas

NumPy

PySpark

Python

GCP

AWS

Azure

Linux

Kubernetes

LLMOps

OpenAI

Job description

Our purpose – Opening up a world of opportunity – explains why we exist. Here at HSBC, we use our unique expertise, capabilities, breadth and perspectives to open new kinds of opportunity for our more than 40 million customers. We’re bringing together the people, ideas, and capital that nurture progress and growth, helping to create a better world – for our customers, our people, our investors, our communities, and the planet we all share.

In Canada, HSBC Global Services (Canada) Limited (HGCA) is a wholly owned subsidiary of HSBC Global Services Limited. Operating in Toronto and Vancouver, HGCA is part of a global service company, delivering services to support the operating entities of HSBC Group. We have different capabilities that provide tools and processes to facilitate the functions, business, and entities with their service management responsibilities.

Chief Technology Office (CTO) Data Technology is a data-driven shared service organization committed to unlocking value from data to serve our customers. We are a unified data technology team with a diverse organization of more than 3,000 colleagues across multiple global locations. We are transforming data technology into an Enterprise Shared Service Capability delivery model that will scale across key Global and Regional business markets.

Our CTO Analytics Technology team is at the forefront of developing cutting‑edge data science platforms across multi‑cloud environments. We leverage advanced analytics and data‑driven insights to enhance our services and drive business growth.

We are looking for a passionate and driven Data Development and Operations (Data DevOps) Engineer to join our CTO Analytics Technology team. In this role, you will work on a state‑of-the‑art data science platform, collaborating with data engineers, data scientists, and other stakeholders to optimize data workflows and enhance our analytics capabilities across multi‑cloud environments.

As our Data DevOps Engineer you will:

• Assist in the development, deployment, and maintenance of data pipelines and workflows using Big Data technologies such as Apache Hadoop (Hadoop), Hadoop Distributed File System (HDFS), Google BigQuery (BigQuery), Amazon EMR (EMR), Snowflake, and Databricks
• Support data science initiatives by utilizing tools such as JupyterHub, MLflow, Google Vertex AI (Vertex AI), Google Cloud Dataproc (Dataproc), Google Cloud Dataflow (Dataflow), and Apache Airflow (Airflow)
• Collaborate with data scientists to implement machine learning models and workflows using libraries such as TensorFlow and scikit‑learn
• Utilize data manipulation libraries such as pandas, NumPy, and PySpark for data analysis and processing
• Develop and maintain Python 3 (Python) applications and Application Programming Interfaces (APIs) to support data workflows and analytics
• Monitor and troubleshoot data pipelines to ensure data quality and reliability
• Participate in the deployment lifecycle of machine learning models and applications, including Machine Learning Operations (MLOps) and Large Language Model Operations (LLMOps) practices
• Work with container orchestration tools such as Kubernetes (K8s) to manage and deploy applications in cloud environments
• Stay updated with the latest trends and technologies in data engineering, DevOps, and cloud computing

You’ll likely have the following qualifications to succeed in this role:

• Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field (or equivalent practical experience)
• Familiarity with Big Data technologies (Hadoop, HDFS, BigQuery, EMR, Snowflake, Databricks)
• Experience with data science tools (JupyterHub, MLflow, Vertex AI, Dataproc, Dataflow, Airflow)
• Experience with data manipulation libraries (pandas, NumPy, PySpark)
• Proficiency in Python, including experience in building APIs and applications
• Familiarity with cloud platforms such as Google Cloud Platform (GCP), Amazon Web Services (AWS), and Microsoft Azure (Azure), and their services
• Basic knowledge of Linux operating systems
• Understanding of Kubernetes (K8s), MLOps/LLMOps, and experience with Large Language Models (LLMs) such as OpenAI, Claude, or Gemini (preferred)

In compliance with applicable laws, HSBC is committed to employing only those who are authorized to work in Canada. Applicants must be legally authorized to work in Canada as HSBC will not engage in immigration sponsorship for this position.

As an HSBC employee, you will have access to tailored professional development opportunities to ensure you have the right skills for today and tomorrow. At HSBC, our overall goal is to provide a competitive Total Reward Package, with an appropriate mix of fixed pay, and variable pay, as part of an employee’s overall total compensation and benefits. Variable pay generally takes the form of discretionary, annual awards (sometimes referred to as a “bonus”). Additionally, HSBC offers a wide range of competitive and flexible benefits designed to help you improve your health and well‑being, finances, and lifestyle.

All qualified applicants will receive consideration for employment without regard to age, ancestry, color, race, national origin, ethnicity, disability or medical condition, genetic information, military or veteran service, religion, creed, sex, gender, pregnancy, childbirth, caregiver status, marital status, citizenship or immigration status, sexual orientation, gender identity or expression or any other trait protected by applicable law.

The final fixed pay offer will depend on the candidate and a number of variables, including but not limited to, role responsibilities, skill set, depth of experience and education, licensing/certification requirements, internal relativity, and specific work location.

At HSBC, our overall goal is to provide a competitive Total Reward Package, with an appropriate mix of fixed pay, and variable pay, as part of an employee’s overall total compensation and benefits. Variable pay generally takes the form of discretionary, annual awards (sometimes referred to as a “bonus”). Additionally, HSBC offers a wide range of competitive and flexible benefits designed to help you improve your health and well‑being, finances, and lifestyle.