Senior Data Engineer :Scala, Spark, Python, Hadoop, Databricks

TD Bank Group; Toronto; On-site; CAD 127,000 - 164,000; Full time

Job summary

TD Securities recherche un data engineer senior pour concevoir et maintenir des pipelines de données évolutifs au sein des plateformes de risques et données. Vous travaillerez avec des équipes transverses afin de livrer des solutions analytiques fiables et performantes.

Le poste implique des environnements de production, du streaming et de l’ETL, avec une forte connaissance de Spark et des technologies cloud. Hybrid à Toronto, avec possibilité de développement et d’amélioration des compétences.

Qualifications

• 5+ années d’expérience en data engineering, Python, Scala et Spark.
• Conception et maintenance de pipelines de données, batch et streaming.
• Expérience avec Databricks Unity Catalog et gouvernance des données.

Responsibilities

• Concevoir et développer des systèmes de traitement de données distribués en Scala, Python et Spark.
• Construire et optimiser des pipelines de données à grande échelle.
• Maintenir l’intégrité et la traçabilité des données via tests et monitoring.
• Collaborer avec data scientists et analystes pour répondre aux besoins en données.

Skills

Python

Scala

Spark

ETL

Databricks

Data pipelines

Akka/Pekko

SQL

REST/GRPC

Cloud Azure

Education

Bachelor’s or Master’s degree in Computer Science/Engineering

Tools

Azure Databricks

Azure ADLS

Dremio

Hadoop

Kafka

Hive

HBase

Kubernetes

Job description

## Ingénieur des données IIIPostuler: Hybride: Toronto, Ontario: Temps plein: Publié aujourd'hui: Date de fin : 13 octobre 2026 (Il reste 14 jours pour postuler): R\\_1512323**Lieu de travail :**Toronto, Ontario, Canada**Horaire :**37.5**Secteur d’activité :**Solutions technologiques**Détails de la rémunération :**$126,800 - $164,100 CADCe poste est admissible à une prime de rémunération variable discrétionnaire qui tient compte du rendement de l’entreprise et du rendement individuel.La TD a à cœur d’offrir une rémunération juste et équitable à tous les collègues. Les occasions de croissance et le perfectionnement des compétences sont des caractéristiques essentielles de l’expérience collègue à la TD. Nos politiques et pratiques en matière de rémunération ont été conçues pour permettre aux collègues de progresser dans l’échelle salariale au fil du temps, à mesure qu’ils s’améliorent dans leurs fonctions. Le salaire de base offert peut varier en fonction des compétences et de l’expérience du candidat, de ses connaissances professionnelles, de son emplacement géographique et d’autres besoins particuliers du secteur et de l’entreprise. En tant que candidat, nous vous encourageons à poser des questions sur la rémunération et à avoir une conversation franche avec votre recruteur, qui pourra vous fournir des détails plus précis sur ce poste.**Description du poste :**# Department Overview TD Securities provides a wide range of capital market products and services to corporate, government and institutional clients who choose us for our knowledge and experience in six key areas of finance: Investment Banking, Debt Capital Markets, Institutional Equities, Private Equity, Precious Metals and Foreign Exchange & Money Market. Our services include the underwriting and distribution of new debt and equity issues, providing advice on strategic acquisitions and divestitures, and executing daily trading and investment needs. With more than 6,500 professionals operating out of 40 cities across the globe, we help clients meet their needs today and prepare for tomorrow. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions. We are growth-oriented, people-focused, and community-minded. As a team, we work to deliver value for our clients every day. ## **Team Description** **The Counterparty Credit Risk group** at TD Securities is seeking experienced Data Engineers to build the next generation of risk computation platforms. The core mission of the applications we build is to help the firm quantify, understand, and reduce our external total exposure in case of adverse market conditions. We operate within a modern and complex area of finance, operating with sophisticated computational models, supporting billions of calculations daily and leveraging Big Data storage for analytics and data distribution. ### **Position Overview:** As a Senior Data Engineer in the XVA and CCR data development team, you will be responsible for designing, building, and maintaining scalable data pipelines that power our analytics and data-driven applications. You will work closely with cross-functional teams to deliver high-quality data solutions and ensure the integrity and availability of our data platforms. **Key Responsibilities:** * Design and develop distributed data processing systems using Scala, Python and Apache Spark.* Build and optimize large-scale data pipelines for batch and streaming data using Spark.* Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.* Maintain a real-time data processing solution build on Scala , Spark , pyspark and Akka/Pekko framework.* Develop and maintain ETL processes to transform and integrate data from various sources.* Experience supporting Credit Risk, Counterparty Credit Risk (CCR), XVA, or Regulatory Reporting data platforms.* Hands-on experience with Databricks Unity Catalog, data lineage, data classification, and access governance frameworks.* Understanding of FpML, financial product modeling, and Capital Markets reference data standards.* Ensure data quality, reliability, and integrity through automated testing and monitoring.* Work with DevOps teams to deploy and manage CI/DC and data pipelines in a cloud environment.* Optimize and tune Spark jobs for performance and scalability.* Participate in code reviews and contribute to the improvement of engineering best practices.* Stay up-to-date with the latest technologies and best practices in data engineering. **Qualifications:** * Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.* 5+ years of experience in data engineering with a strong focus on Python, Scala and Spark.* Strong understanding of data warehousing and data modeling concepts and ETL processes.* Hands-on experience with cloud data platforms like Azure ADLS, Azure Databricks and Dremio.* Hands-on Experience with big data technologies such as Hadoop, Kafka, Hive and HBase.* Hands-on experience with the Akka/Pekko framework for building distributed systems.* Understanding of data communication protocol like REST and GRPC* Proficiency in SQL and experience with relational and NoSQL databases.* Experience with cloud platforms (e.g., GCP, Azure) and containerization technologies (e.g., Docker, Kubernetes) is a plus.* Excellent problem-solving skills and ability to work independently and in a team.* Strong communication skills and ability to collaborate with cross-functional teams. **Preferred Skills:** * Experience with Apache Kafka or Confluent is a plus.* Proficiency with C# for excel addins.* Experience with CI/CD pipelines and infrastructure as code (IaaC).* Knowledge of data governance and security best practices.* Knowledge of Capital Markets is a plus* Familiarity with machine learning and data science workflows.* Experience with real-time analytics and event-driven architectures. **Non-Technical Skills:*** Experience in collaborating efficiently within a global team* Strong communication skills* Demonstrable experience working in a fast-paced environment, and supportive of flexible goals aligned with business priorities* Knowledge of derivatives pricing and capital markets is a plus **Additional Information:** **Join in on what others in TD Global Technology Solutions are doing:*** Inspire a positive work environment and help champion quality, innovation, teamwork and service to the business.* Learn voraciously, stretch your thinking, share your knowledge and educate others.* Communicate and collaborate with both technical and non-technical professionals.* Cultivate winning relationships by building trust with business and technology partners.* Share our commitment to productivity, effectiveness and operational efficiency. #LI-Tech