Big Data - Automation Engineer

RBC; Toronto; On-site; CAD 80,000 - 110,000; Full time

Job summary

Join a fast-paced Finance IT team at a leading bank where you'll focus on Test Implementation and Automation for high-impact Big Data solutions. You will lead a Quality Engineering team in enhancing automation processes and ensure data accuracy and system performance in a dynamic environment.

Benefits

Comprehensive Total Rewards Program

Competitive compensation

Flexible benefits

World-class training program

Flexible work/life balance options

Qualifications

• 3-4 years of QA experience focused on Big Data testing and automation.
• Hands-on experience with technologies such as Hadoop, Spark, Hive, Kafka.
• Proficiency in Python, Java, or Scala for test automation.

Responsibilities

• Design, develop, and execute automated test scripts for Big Data pipelines.
• Perform end-to-end testing of Big Data applications to ensure data integrity.
• Collaborate with developers to define test strategies.

Skills

Application Testing

Decision Making

Detail-Oriented

Group Problem Solving

IT Quality Assurance

Predictive Analytics

Programming Languages

Quality Engineering

Software Product Testing

Test Automation

Education

Bachelor's/Master’s in Computer Science or related studies

Tools

Selenium

TestNG

JUnit

Apache Spark

Hadoop

Hive

Kafka

Job description

Job Summary

Job Description

What is the opportunity?
You will be part of our fast paced Finance IT team and will be responsible for Test Implementation and Test Automation oversight on our Big Data Platform using latest technologies like Cloud, Kafka, and Containerization. The project comprises of teams of QE professionals providing Test Services for the applications and programs within Finance IT. Your role will focus on leading the team providing and improving on QE Automation for these groups while implementing test execution. This position provides you opportunity to demonstrate and build technical processes and architecture as well and leadership skills while providing IT solutions to highly volatile business environment.

What will you do?

Key Responsibilities:

• Design, develop, and execute automated test scripts for Big Data pipelines, ETL processes, and data validation.

• Perform end-to-end testing of Big Data applications, ensuring data accuracy, integrity, and performance.

• Collaborate with developers, data engineers, and business analysts to understand requirements and define test strategies.

• Validate data transformations, data ingestion, and data processing workflows in distributed systems.

• Identify, document, and track defects, ensuring timely resolution.

• Develop and maintain test automation frameworks for Big Data environments.

• Conduct performance testing to ensure scalability and reliability of Big Data systems.

• Work with tools like Apache Spark, Hadoop, Hive, Kafka, and other Big Data technologies to validate data workflows.

• Ensure compliance with data quality standards and best practices.

• Continuously improve testing processes and automation coverage.

Required Skills and Qualifications:

• 3-4 years of experience in QA with a focus on Big Data testing and automation.

• Hands-on experience with Big Data technologies such as Hadoop, Spark, Hive, Kafka, or similar.

• Proficiency in programming/scripting languages like Python, Java, or Scala for test automation.

• Experience with test automation tools and frameworks (e.g., Selenium, TestNG, JUnit, or custom frameworks for Big Data).

• Strong understanding of ETL processes, data pipelines, and data validation techniques.

• Familiarity with SQL and the ability to write complex queries for data validation.

• Knowledge of version control systems (e.g., Git) and CI/CD pipelines.

• Excellent problem-solving skills and attention to detail.

• Strong communication and collaboration skills to work effectively in a team environment.

Preferred Qualifications:

• Bachelors/master’s in computer science or relates studies

• Experience with cloud platforms like AWS, Azure, or Google Cloud for Big Data solutions.

• Knowledge of containerization tools like Docker and orchestration tools like Kubernetes.

• Familiarity with data visualization tools and reporting frameworks.

• ISTQB or other relevant QA certifications.

What’s in it for you?

• We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable

• Leaders who support your development through coaching and managing opportunities

• Ability to make a difference and lasting impact

• Work in a dynamic, collaborative, progressive, and high-performing team

• A world-class training program in financial services

• Flexible work/life balance options

• Opportunities to do challenging work

• Opportunities to take on progressively greater accountabilities

• Opportunities to building close relationships with clients

#LI-ASPOST

#TECHPJ

Job Skills

Application Testing, Decision Making, Detail-Oriented, Group Problem Solving, IT Quality Assurance, Long Term Planning, Predictive Analytics, Programming Languages, Quality Engineering, Software Product Testing, Test Automation

Additional Job Details

Address:

RBC CENTRE, 155 WELLINGTON ST W:TORONTO

City:

TORONTO

Country:

Canada

Work hours/week:

37.5

Employment Type:

Full time

Platform:

TECHNOLOGY AND OPERATIONS

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

2025-03-18

Application Deadline:

2025-07-22

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Inclusion and Equal Opportunity Employment

At RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities at jobs.rbc.com.