Senior Data Engineer

CGI Group, Inc.; Portland (OR); Remote; USD 63,000 - 139,000; Full time

Benefits offered by this job

Profit participation program

Medical, dental, and vision benefits

401(k) matching and CGI share purchase

Job summary

CGI Group, Inc. is hiring a Senior Data Engineer to design and execute end-to-end test plans for enterprise data platforms and ETL/ELT pipelines.

You will validate data accuracy, transformations and quality across source and target systems, writing complex SQL and leveraging Databricks, Spark, PySpark and Python. The role requires hands-on testing experience with Hadoop/HDFS, Hive, and Azure Data Factory, in a Unix/Linux environment, and collaboration within Agile/Scrum teams.

Qualifications

• 8+ years of experience in software quality engineering/testing with emphasis on ETL testing, data validation, integration testing and regression testing.
• Strong SQL skills with complex queries for source-to-target validation, reconciliation and data quality testing.
• Experience testing large-scale data platforms and ETL/ELT pipelines.
• Hands-on with Databricks, Apache Spark, PySpark, Python and Azure Data Factory (ADF).
• Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive.
• Experience working in Unix/Linux and using enterprise job scheduling tools such as Control M.
• Solid understanding of data quality concepts, data transformations, data mappings, and source-to-target validation.
• Experience with defect management and test management processes in Agile/Scrum delivery environments.
• Strong analytical, troubleshooting, communication and collaboration skills.

Responsibilities

• Design, develop, and execute test plans, scenarios, and cases for enterprise data platforms, ETL/ELT pipelines and data integration solutions.
• Run end-to-end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation and data quality across systems.
• Write complex SQL queries to support backend testing and data validation.
• Test large-scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS and Azure Data Factory (ADF).
• Perform functional, integration, regression, system and data quality testing for data pipelines and data-driven applications.
• Validate batch processing, job scheduling, dependencies and workflow execution using Control M and Unix/Linux environments.
• Identify, document, track and retest defects while partnering with developers, data engineers and business analysts.
• Develop and maintain reusable test scripts and automation where applicable.
• Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews and retrospectives.

Skills

ETL testing

Data validation

Integration testing

Regression testing

SQL

Databricks

Apache Spark

PySpark

Python

Azure Data Factory

Hadoop/HDFS

Hive

Unix/Linux

Control-M

Data quality

Defect management

Agile/Scrum

Analytical thinking

Tools

Databricks

Apache Spark

PySpark

Python

Azure Data Factory

Hadoop/HDFS

Hive

Unix/Linux

Control-M

Job description

Work remotely from Oregon (USA) as a Senior Data Engineer at CGI Group, Inc., helping deliver reliable enterprise data platforms and ETL/ELT pipelines through rigorous testing, validation, and automation. This role combines strong technical depth with Agile/Scrum collaboration, supported by competitive compensation (USD 62,900 - 139,300 yearly) and a benefits package designed for your wellbeing and long-term growth.

You will design and execute end-to-end test plans that validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems. If you enjoy turning quality concepts into repeatable testing assets and SQL-based checks, this position is built for that kind of impact.

What you’ll do

• Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions.
• Run end-to-end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across systems.
• Write complex SQL queries to support backend testing and data validation.
• Test large-scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF).
• Perform functional, integration, regression, system, and data quality testing for data pipelines and data-driven applications.
• Validate batch processing, job scheduling, dependencies, and workflow execution using Control M and Unix/Linux environments.
• Identify, document, track, and retest defects while partnering with developers, data engineers, business analysts, and other stakeholders.
• Develop and maintain reusable test scripts and automation solutions where applicable.
• Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews, and retrospectives.

What you bring

• 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing.
• Strong hands‑on SQL skills, including complex queries for source-to-target validation, reconciliation, and data quality testing.
• Experience testing large-scale data platforms and ETL/ELT pipelines.
• Hands‑on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).
• Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive.
• Experience working in Unix/Linux and using enterprise job scheduling tools such as Control M.
• Solid understanding of data quality concepts, data transformations, data mappings, and source-to-target validation.
• Experience with defect management and test management processes in Agile/Scrum delivery environments.
• Strong analytical, troubleshooting, communication, and collaboration skills.

Benefits

• Competitive compensation including a profit participation program
• Comprehensive medical, dental, and vision benefits
• Basic life and accidental death & dismemberment insurance
• 401(k) matching contributions and a CGI share purchase plan
• Flexibility and paid accrued vacation leave of 10 to 20 days per year, based on job level, years of relevant prior experience, and years of service
• 10 paid holidays per year
• At least 80 consecutive hours of paid sick/safe leave (with exceptions where state/local law requires more)
• Paid parental leave ranging from 20 to 70 consecutive business days based on circumstances of leave and applicable laws
• Bereavement leave ranging from 1 to 7 days per year based on relationship
• Paid jury duty leave, up to time summoned
• Learning opportunities and tuition assistance
• Wellness and Well being programs