Senior Big Data Engineer – Spark, Scala & Data Platforms

RBC; Halifax; On-site; CAD 90,000 - 120,000; Full time

Job summary

A leading financial institution in Halifax is seeking a seasoned big data developer to focus on building high-performance applications within their compliance technology team. The ideal candidate will have over 7 years of experience with technologies like Spark and Scala, and will be tasked with designing scalable data solutions and ensuring data quality. This role offers a collaborative workspace and the opportunity to contribute to innovative projects that impact the financial services sector. Competitive compensation and flexible work-life balance options are included.

Benefits

Total Rewards Program

Flexible benefits

Competitive compensation

Coaching and development opportunities

Work-life balance options

Challenging work opportunities

Qualifications

• 7+ years of hands-on development experience with big data technologies.
• Strong skills in Scala and Python for production-grade applications.
• Experience working with big data platforms like Databricks or Snowflake.
• Knowledge of streaming technologies and event-driven architectures.
• Understanding of data structures and performance optimization.

Responsibilities

• Develop expertise in trade surveillance data infrastructure.
• Design and implement scalable data pipelines and ETL processes.
• Build and optimize data models to support analytics needs.
• Collaborate with teams to gather requirements for data solutions.
• Implement data quality frameworks to ensure accuracy.

Skills

Active Learning

Agile Methodology

Application Integrations

Detail-Oriented

Emerging Technologies

Enterprise Application Delivery

Group Problem Solving

Programming Languages

Software Development Life Cycle (SDLC)

Tools

Spark

Scala

Python

Databricks

Snowflake

Hadoop

Kafka

Docker

Kubernetes

Job description

A leading financial institution in Halifax is seeking a seasoned big data developer to focus on building high-performance applications within their compliance technology team. The ideal candidate will have over 7 years of experience with technologies like Spark and Scala, and will be tasked with designing scalable data solutions and ensuring data quality. This role offers a collaborative workspace and the opportunity to contribute to innovative projects that impact the financial services sector. Competitive compensation and flexible work-life balance options are included.