Tester - Data Quality

Procom; North Vancouver; Remote; CAD 80,000 - 120,000; Full time

Job summary

A consulting firm is seeking a Tester - Data Quality responsible for analyzing source data and developing data pipelines using Scala and Spark. The role emphasizes data validation and documentation while working fully remotely on PST hours. Applicants should have a solid background in Big Data platforms and relevant experience with SQL development and data modeling.

Qualifications

• Applied knowledge in Big Data platforms and Hadoop ecosystem is mandatory.
• Solid experience in Scala programming is essential.
• Excellent skills in SQL development and data modeling are required.

Responsibilities

• Develop Spark and Scala pipelines for data ingestion and transformation as per the mapping document.
• Conduct data analysis and develop data models/mapping.
• Perform data validations and create automated data quality pipelines.
• Produce relevant documentation for the sustainment of processes.

Skills

Big Data platforms knowledge

Scala

Spark

SQL development

Data modeling

Hadoop ecosystem

Structured and unstructured databases

Tools

StreamSets

Hadoop

Oracle

Job description

Tester - Data Quality

On behalf of our client, Procom Consultants Group is currently looking for a Tester - Data Quality

Tester - Data Quality Job Details

Analyze the source data, prepare data model & mapping, and develop

Scala / Spark programs and related components in the work areas of Information

Management ("IM") relating to claims, insurance and finance data.

Use data pipelines to extract data from data sources which are in various

formats (viz - flat files, XML, relational tables, Oracle logs), and

Use tools (such as StreamSets, Scala and Spark programs) to transform and

store the data in big data platform (Data Lake) after data validation.

Deliverables :

1. Develop Spark and Scala pipelines for data ingestion and Data transformation

as per the mapping document

2. Data Analysis as per requirements and develop data models / mapping

3. Data validations and automated data quality pipelines

4. Relevant documentation for sustainment

Tester - Data Quality Mandatory Skills

Applied knowledge in Big Data platforms, ideally with exposure to

Hadoop ecosystem (HDFS, Pig, Hive, SPARK, Big SQL, NoSQL, YARN);

Solid experience in Scala

• Experience in designing efficient and robust data pipelines using Spark;
• Excellent skill in SQL development;
• Knowledge of data modeling and understanding of different data

structures and their benefits and limitations under particular use cases;

Hands-on experience with structured and unstructured databases;

Experience with enterprise systems such as Guidewire Claim Center, Guidewire

Policy Center would be an asset;

Tester - Data Quality Start Date

August 1, 2025

Tester - Data Quality Assignment Duration

November 28, 2025 (dependent on actual start date)

Tester - Data Quality Working Location

Fully remote but PST hours