Senior Data Engineer - GFT Halifax

RBC; Halifax; On-site; CAD 100,000 - 130,000; Full time

Job summary

A major financial institution in Halifax is seeking a skilled professional to join their Compliance Technology team. The role involves designing and maintaining data pipelines using Python and PySpark while ensuring compliance with trading systems. The ideal candidate has extensive experience in data management and cloud technologies. This position offers a comprehensive rewards program and flexible work options.

Benefits

Comprehensive Total Rewards Program

Competitive compensation

Flexible work/life balance options

Qualifications

• 8+ years of experience in Python and Java.
• Proven ability to develop and troubleshoot large-scale applications.
• Experience as a technology lead, applying best engineering practices.

Responsibilities

• Design and maintain scalable data pipelines using Python and PySpark.
• Optimize data workflows and processes for performance.
• Collaborate with clients to analyze business requirements.

Skills

Python

Java

Big Data technologies

REST APIs

Agile methodologies

Tools

Hadoop

Spark

PySpark

CI/CD pipelines

Docker

Kubernetes

Job description

Job Description

What is the Opportunity?

The Compliance team, part of Global Functions Technology (GFT), focuses on trading and employee surveillance, privacy, and risk governance. This role is situated within the Compliance Technology division of GFT. The ideal candidate will be responsible for designing and implementing innovative solutions while addressing complex challenges across various projects within the trade surveillance ecosystem. A key responsibility of this role includes developing models outside of Kx using PySpark.

What will you do?

• Design, develop, and maintain scalable and efficient data pipelines using Python, PySpark, and Big Data technologies.
• Optimize data workflows and processes for performance and scalability.
• Process and analyze large-scale datasets using distributed computing frameworks.
• Implement best practices for data storage, retrieval, and processing to ensure efficiency.
• Create system designs, software architecture, and technical solutions aligned with organizational strategies.
• Provide expertise and guidance to the Compliance Technology team on software design, system architecture, and solution-oriented technologies.
• Collaborate with clients to analyze business requirements, recommend solutions, and shape future plans for Compliance Technology.
• Contribute to the design, evaluation, and enhancement of data systems, tools, and technologies to ensure scalability, reliability, and security.

What do you need to succeed?

Must Have

• 8+ years of experience in Python and Java, with strong proficiency in Java frameworks (REST APIs/Microservices, Spring Framework) and Big Data tools like Hadoop, Spark, and PySpark.
• Proven ability to develop, test, and troubleshoot large-scale applications, including RESTful APIs and interface specifications (Swagger, OpenAPI, SOAP).
• Experience as a technology lead, applying best engineering practices (e.g., peer reviews) and mentoring junior developers in technical and best practice areas.
• Strong analytical skills, clean coding practices, and a focus on scalability and robust system design.
• Proficiency in CI/CD pipelines, testing automation tools, and a solid understanding of Agile methodologies, with a passion for technology and software development culture.

Nice to Have

• Experience in Capital Markets, Wealth Management, and/or regulatory environments, with an understanding of trading systems, financial markets, and related data structures.
• Strong skills in object-oriented programming, microservice design patterns (e.g., load balancing, resiliency), and knowledge of data governance and security practices.
• Experience with cloud platforms (AWS, Azure, Google Cloud), CI/CD pipelines, containerization (Docker), orchestration tools (Kubernetes), and DevOps tools like Jenkins and GitHub Actions.
• Familiarity with time-series databases, KX, and kdb+.

What’s in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable.
• Leaders who support your development through coaching and managing opportunities.
• Ability to make a difference and lasting impact.
• Work in a dynamic, collaborative, progressive, and high-performing team.
\
• A world-class training program in financial services.
• Flexible work/life balance options.
• Opportunities to do challenging work.

Job Skills

Big Data Management, Cloud Computing, Database Development, Data Mining, Data Warehousing (DW), ETL Processing, Group Problem Solving, Quality Management, Requirements Analysis

Additional Job Details

Address: 120 WESTERN PKY:BEDFORD

City: Bedford

Country: Canada

Work hours/week: 37.5

Employment Type: Full time

Platform: TECHNOLOGY AND OPERATIONS

Job Type: Regular

Pay Type: Salaried

Posted Date: 2025-11-14

Application Deadline: 2025-12-26

Note

Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Inclusion and Equal Opportunity Employment

At RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.