ETL Tester - GCP | Remote

Compunnel; United States; Remote; USD 70,000 - 110,000; Full time

Job summary

An established industry player is seeking a data engineer with a strong background in data testing and cloud technologies. In this dynamic role, you will develop and implement test strategies, ensuring data accuracy and optimizing data pipelines within the Google Cloud Platform ecosystem. You will collaborate with cross-functional teams, document test cases, and perform data validation to ensure high-quality deliverables. If you are passionate about data integrity and enjoy working in a fast-paced environment, this opportunity is perfect for you.

Qualifications

• 3-5+ years of experience in data engineering or quality assurance.
• Strong understanding of ETL/ELT processes and data modeling.
• GCP or relevant certification in software testing.

Responsibilities

• Develop and implement test cases for ETL/ELT pipelines and data transformation.
• Monitor and troubleshoot data issues across the pipeline.
• Collaborate with Data Engineers and Analysts to define quality requirements.

Skills

SQL

Data Validation

Data Engineering

Test Automation

ETL/ELT Processes

Analytical Skills

Problem-Solving

Attention to Detail

Collaboration

Communication Skills

Education

Bachelor's Degree in Computer Science or related field

Tools

Jira

Confluence

SharePoint

Google Cloud Platform

BigQuery

Dataflow

Great Expectations

dbt

Job description

Job Summary:

• This role involves developing and implementing test strategies, ensuring data accuracy, Application performance and integrity, and optimising data pipelines within the Google Cloud Platform (GCP) ecosystem. The ideal candidate will have a strong background in data engineering, test automation, and cloud technologies, with expertise in SQL and general understanding of BigQuery and Dataflow. Familiarity with using software management and collaboration tools such as Jira, Confluence, and SharePoint.

Key Responsibilities:

• Partner with Data Engineers, Analysts, and business stakeholders to define quality requirements.
• Document test cases, data validation rules, and best practices for scalable data governance.
• Develop and implement test cases for ETL/ELT pipelines, data transformation, and ingestion processes.
• Perform data validation, execute test cases (manual or automated) and analyze results. Regression testing ensures sufficient error validation is present. Reconcile variances and data anomalies to ensure high-quality data.
• Validate data transformations and ingestion processes for structured and unstructured data.
• Monitor and troubleshoot data issues, failures, and inconsistencies across the pipeline.
• Provide support for root cause analysis and resolution of data-related defects, including the identification of code changes.
• Document and track defects, providing detailed reports to development teams for resolution.
• Participate in the design and implementation of automated testing scripts to improve testing efficiency.
• Conduct regression testing to ensure that new code changes do not adversely affect existing functionality.
• Perform post-release and post-implementation validation of software performance in production environments.
• Continuously monitor and evaluate the quality of software deliverables, providing feedback for improvement opportunities.
• Collaborate with end users to gather feedback.

Qualifications & Skills:

Must Have:

• 3-5+ years of experience in data engineering, data testing, or quality assurance.
• Proficiency in SQL, and data validation frameworks. (test strategies).
• An understanding of ETL/ELT processes, data modeling, and schema design.

Nice-To-Have:

• Familiarity with automated testing frameworks for data (e.g., Great Expectations, dbt tests).
• Familiarity with GCP data services (BigQuery, Dataflow, Dataproc, Cloud Storage) and Python.

Additional:

• Strong understanding of software development and testing methodologies.
• Excellent analytical and problem-solving skills.
• Attention to detail and ability to document defects accurately.
• Highly collaborative. Effectively works with cross-functional teams for the support and performance of the EDP and packaged applications.
• Strong understanding of project management methodologies, including Agile and Waterfall.
• Effective communication skills, both written and verbal, to collaborate with cross-functional teams.
• Familiarity with programming languages (e.g., Java, Python) and scripting for automated testing.
• Ability to work independently and manage multiple tasks simultaneously.
• GCP or other relevant certification in software testing.

Working Conditions:

• Ability to work in a fast-paced, dynamic environment.

Triage Skills:

1. Prioritization: Assess and prioritize software issues based on severity, frequency, and impact.
2. Collaboration: Work with stakeholders and technical leads to determine the best course of action for resolving issues.
3. Decision-Making: Make informed decisions on which issues to address first, balancing business needs and technical feasibility.
4. Communication: Clearly communicate the status and priority of issues to all relevant parties.
5. Problem-Solving: Quickly identify the root cause of issues and propose effective solutions.