Senior Data Engineer :Scala, Spark, Python, Hadoop, Databricks
TD Bank
Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.
Job summary
TD Securities is seeking a Senior Data Engineer to design, build, and maintain scalable data pipelines powering analytics for the Counterparty Credit Risk and XVA teams in the Technology Solutions group. You will work with Scala, Spark, PySpark, and Akka/Pekko to deliver reliable data platforms that support billions of calculations daily.
You will collaborate with data scientists and analysts, implement ETL processes, and ensure data quality and governance in a cloud environment, with a focus on
Qualifications
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
- 5+ years of experience in data engineering with Python, Scala and Spark.
- Strong understanding of data warehousing and ETL processes.
- Hands-on experience with cloud data platforms like Azure ADLS, Azure Databricks and Dremio.
Responsibilities
- Design and develop distributed data processing systems using Scala, Python and Apache Spark.
- Build and optimize large-scale data pipelines for batch and streaming data using Spark.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
- Maintain real-time data processing solution built on Scala, Spark, PySpark and Akka/Pekko framework.
- Develop and maintain ETL processes to transform and integrate data from various sources.
- Experience supporting Credit Risk, Counterparty Credit Risk (CCR), XVA, or Regulatory Reporting data platforms.
- Hands-on experience with Databricks Unity Catalog, data lineage, data classification, and access governance frameworks.
- Understanding of FpML, financial product modeling, and Capital Markets reference data standards.
- Ensure data quality, reliability, and integrity through automated testing and monitoring.
- Work with DevOps teams to deploy and manage CI/DC and data pipelines in a cloud environment.
- Optimize and tune Spark jobs for performance and scalability.
- Participate in code reviews and contribute to the improvement of engineering best practices.
- Stay up-to-date with the latest technologies and best practices in data engineering.
Skills
Education
Tools
Job description
Hybrid
Toronto, Ontario
Full time
R_1512323
Work Location:
Toronto, Ontario, Canada
Hours:
37.5
Line of Business:
Technology Solutions
Pay Details:
$126,800 - $164,100 CAD
This role is eligible for a discretionary variable compensation award that considers business and individual performance.
TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.
As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.
TD Securities provides a wide range of capital market products and services to corporate, government and institutional clients who choose us for our knowledge and experience in six key areas of finance: Investment Banking, Debt Capital Markets, Institutional Equities, Private Equity, Precious Metals and Foreign Exchange & Money Market. Our services include the underwriting and distribution of new debt and equity issues, providing advice on strategic acquisitions and divestitures, and executing daily trading and investment needs.
With more than 6,500 professionals operating out of 40 cities across the globe, we help clients meet their needs today and prepare for tomorrow. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions.
We are growth-oriented, people-focused, and community-minded. As a team, we work to deliver value for our clients every day.
The Counterparty Credit Risk group at TD Securities is seeking experienced Data Engineers to build the next generation of risk computation platforms. The core mission of the applications we build is to help the firm quantify, understand, and reduce our external total exposure in case of adverse market conditions. We operate within a modern and complex area of finance, operating with sophisticated computational models, supporting billions of calculations daily and leveraging Big Data storage for analytics and data distribution.
As a Senior Data Engineer in the XVA and CCR data development team, you will be responsible for designing, building, and maintaining scalable data pipelines that power our analytics and data-driven applications. You will work closely with cross-functional teams to deliver high-quality data solutions and ensure the integrity and availability of our data platforms.
Design and develop distributed data processing systems using Scala, Python and Apache Spark.
Build and optimize large-scale data pipelines for batch and streaming data using Spark.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Maintain a real-time data processing solution build on Scala , Spark , pyspark and Akka/Pekko framework.
Develop and maintain ETL processes to transform and integrate data from various sources.
Experience supporting Credit Risk, Counterparty Credit Risk (CCR), XVA, or Regulatory Reporting data platforms.
Hands-on experience with Databricks Unity Catalog, data lineage, data classification, and access governance frameworks.
Understanding of FpML, financial product modeling, and Capital Markets reference data standards.
Ensure data quality, reliability, and integrity through automated testing and monitoring.
Work with DevOps teams to deploy and manage CI/DC and data pipelines in a cloud environment.
Optimize and tune Spark jobs for performance and scalability.
Participate in code reviews and contribute to the improvement of engineering best practices.
Stay up-to-date with the latest technologies and best practices in data engineering.
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
5+ years of experience in data engineering with a strong focus on Python, Scala and Spark.
Strong understanding of data warehousing and data modeling concepts and ETL processes.
Hands-on experience with cloud data platforms like Azure ADLS, Azure Databricks and Dremio.
Hands-on Experience with big data technologies such as Hadoop, Kafka, Hive and HBase.
Hands-on experience with the Akka/Pekko framework for building distributed systems.
Understanding of data communication protocol like REST and GRPC
Proficiency in SQL and experience with relational and NoSQL databases.
Experience with cloud platforms (e.g., GCP, Azure) and containerization technologies (e.g., Docker, Kubernetes) is a plus.
Excellent problem-solving skills and ability to work independently and in a team.
Strong communication skills and ability to collaborate with cross-functional teams.
Experience with Apache Kafka or Confluent is a plus.
Proficiency with C# for excel addins.
Experience with CI/CD pipelines and infrastructure as code (IaaC).
Knowledge of data governance and security best practices.
Knowledge of Capital Markets is a plus
Familiarity with machine learning and data science workflows.
Experience with real-time analytics and event-driven architectures.
Experience in collaborating efficiently within a global team
Strong communication skills
Demonstrable experience working in a fast-paced environment, and supportive of flexible goals aligned with business priorities
Knowledge of derivatives pricing and capital markets is a plus
Inspire a positive work environment and help champion quality, innovation, teamwork and service to the business.
Learn voraciously, stretch your thinking, share your knowledge and educate others.
Communicate and collaborate with both technical and non-technical professionals.
Cultivate winning relationships by building trust with business and technology partners.
Share our commitment to productivity, effectiveness and operational efficiency.
#LI-Tech
TD Securities offers a wide range of capital markets products and services to corporate, government, and institutional clients who choose us for our innovation, execution, and experience. With more than 6,500 professionals operating out of 40 cities across the globe, we strive to make every interaction, product and experience remarkably human and refreshingly simple. Our services include underwriting and distributing new issues, providing trusted advice and industry-leading insight, extending access to global markets, and delivering integrated transaction banking solutions. In 2023, we acquired Cowen Inc., offering our clients access to a premier U.S. equities business and highly-diverse equity research franchise, while growing our strong, diversified investment bank.
Together, we are reimagining what banking can be for our clients, colleagues and communities.
Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more (http://www.td.com/ca/en/about-td/who-we-are/benefits-of-working-at-td)
We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.
Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations, requirements.
If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities.
If you’re passionate about helping clients and building deep, lasting relationships, TD offers diverse career paths where you can grow your expertise and make a meaningful impact.
We're committed to your success and foster a respectful workplace where diverse perspectives are valued, everyone has fair opportunities to grow, and you can unlock your full potential to achieve your career goals. Here at TD, we hire and develop the best.
We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.
We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.
Your accessibility is important to us. Please let us know if you’d like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.
We look forward to hearing from you!
Sans Objet
US Labor & Employment Posters (https://tdbank.site.findly.com/wp-content/uploads/sites/3875/2026/07/USApplicantRights_revised_7-13-2026.pdf) | California Privacy (https://www.td.com/us/en/personal-banking/privacy/california/) |
Accessibility (https://www.td.com/us/en/personal-banking/universal-footer/accessibility/) | FAQ (https://cdn-static.findly.com/wp-content/uploads/sites/3345/2024/08/02032545/FAQ_EN.pdf)
At TD we’re guided by our purpose to enrich the lives of our customers, communities and colleagues, and share a set of values that shape our culture and guide our behavior. In exchange for how our colleagues show up to help TD succeed, we are committed to delivering a colleague experience grounded in Impact, Growth and a Culture of Care. No matter where you work across TD, we empower you to make an impact at work and in your community, explore and grow your career and be part of our caring and inclusive culture.
At TD, we’re committed to fostering an environment where all colleagues are encouraged to bring their authentic selves to work, experience equitable opportunities, and feel respected and supported. We’re dedicated to building an inclusive workforce that reflects the diversity of the customers and the communities in which we live and serve.
TD has a long-standing commitment to help drive progress towards a more inclusive and sustainable future. That’s why we launched the TD Ready Commitment in 2018, now a multi-year North American initiative. Under the TD Ready Commitment, we are targeting a total of C$1 billion by 2030 in community giving across four key, interconnected drivers of change: Financial Security, Vibrant Planet, Connected Communities, and Better Health. It’s our goal to help support change, nurture progress, and contribute to making the world a better, more inclusive place for our customers, colleagues, and communities. Learn more: Canada (https://www.td.com/ca/en/about-td/ready-commitment) | US (https://www.td.com/us/en/about-us/communities/ready-commitment) | Europe & Asia Pacific (https://www.td.com/ca/en/about-td/ready-commitment)
Federal law prohibits job discrimination based on race, color, sex, sexual orientation, gender identity, national origin, religion, age, equal pay, disability and genetic information.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
