Senior Big Data Engineer: Scalable Pipelines & Compliance

RBC; Halifax; Hybrid; CAD 85,000 - 110,000; Full time

Job summary

A leading Canadian bank in Halifax is seeking a Compliance Technology expert to design and implement innovative solutions in trade surveillance. This role demands strong experience in Python and Java, with a focus on developing scalable data pipelines and optimizing workflows. Candidates should exhibit leadership qualities and a solid understanding of best engineering practices. Enjoy a dynamic work environment with opportunities for professional growth and a comprehensive benefits package.

Benefits

Comprehensive Total Rewards Program

Flexible benefits

Opportunities for professional growth

Qualifications

• 4+ years of experience in Python and Java/Scala with strong proficiency in Java frameworks.
• Proven ability to develop, test, and troubleshoot large-scale applications.
• Experience as a technology lead with best engineering practices.
• Strong analytical skills and focus on scalability.

Responsibilities

• Design, develop, and maintain scalable data pipelines.
• Optimize data workflows for performance and scalability.
• Collaborate with clients to analyze business requirements.
• Contribute to the design and enhancement of data systems.

Skills

Python

Java

Scala

Big Data technologies

REST APIs

Agile methodologies

Tools

Hadoop

Spark

PySpark

Docker

Kubernetes

Job description

A leading Canadian bank in Halifax is seeking a Compliance Technology expert to design and implement innovative solutions in trade surveillance. This role demands strong experience in Python and Java, with a focus on developing scalable data pipelines and optimizing workflows. Candidates should exhibit leadership qualities and a solid understanding of best engineering practices. Enjoy a dynamic work environment with opportunities for professional growth and a comprehensive benefits package.