Senior IT Software Quality Engineer – Data & ETL ( M/F/H )

Everience; Rotterdam; On-site; EUR 65,000 - 90,000; Full time

Job summary

Everience is seeking an experienced Senior IT Software Quality Engineer Data & ETL to lead QA across data pipelines and cloud ecosystems. You will test end-to-end ETL processes, validate data accuracy, and work with developers, data engineers and product owners to ensure data quality.

Strong SQL, Python/PySpark skills and Azure data services are required. You will combine hands-on testing with data analysis and contribute to test automation where possible, while supporting API and integration

Qualifications

• Several years of experience as a Software Quality Engineer, Data QA Engineer, Data Test Engineer or similar role.
• Demonstrable experience with ETL Testing / Big Data Testing.
• Strong knowledge of SQL and data validation.
• Hands-on with Python, PySpark and Pandas and Azure data tools.

Responsibilities

• Plan, execute and continuously improve QA activities for data pipelines and cloud environments.
• Test end-to-end data flows, ETL processes and cross-system data validation.
• Coordinate with developers, data engineers, analysts and product stakeholders.
• Develop and maintain test plans, cases and automation where possible.
• Validate API and data exchange between applications; use Postman for testing.
• Manage defect lifecycle and report on quality metrics and risks.

Skills

Software Quality Engineer

Data QA Engineer

ETL Testing

Big Data Testing

SQL

Python

PySpark

Pandas

Azure DevOps

Azure Data Factory

Azure Databricks

Azure Data Lake Gen2

Postman

Education

Bachelor's or Master's in CS/IT/Data Engineering/Software Engineering

Tools

Postman

Azure DevOps

Azure Data Factory

Azure Databricks

Azure Data Lake Gen2

Python

PySpark

Pandas

Job description

Everience is an international consulting group delivering AI-augmented digital services and placing people at the heart of the AI revolution.

With a presence in Europe, Africa, Asia and America, Everience offers its 4,000-strong workforce the most demanding and stimulating environment in which to transform and develop their skills, learning about new AI-based roles and building their future employability.

Through its Symbiotic Academy the group offers a unique hub for training, practical application and exchange where everyone can experiment, learn, and progress in the fields of artificial intelligence and data.

In accordance with its core purpose of orchestrating the symbiotic relationship between humans and AI in the workplace, Everience is making the augmented employee the driving force of a “symbiotic age”, where AI enhances talents and opens up new career opportunities.

We are looking for an experiencedIT Software Quality Engineer Data & ETLwho will be responsible for leading and executing quality assurance activities within complex data platforms and cloud-based ecosystems.

In this role, the focus is on ensuring thequality, accuracy, completeness and reliability of dataacross end-to-end data pipelines. You will work at the intersection of software testing, data engineering, ETL, Big Data and cloud technologies.

You are analytical, technically skilled and able to independently execute testing activities while coordinating effectively with developers, data engineers, business analysts, product owners and other stakeholders.

The Role:

As aSenior IT Software Quality Engineer Data & ETL, you will be responsible for planning, executing and continuously improving QA activities within data-intensive environments.

You will test end-to-end data flows and ETL processes, ensuring that data is correctly extracted, transformed and loaded. You will also validate data across different systems and identify deviations, inconsistencies and data quality issues.

You combine hands-on testing with data analysis and work closely with both technical and business stakeholders.

ETL & Data Validation:

• Performing end-to-end testing of ETL and data workflows
• Validating extraction, transformation and loading processes
• Performing data reconciliation and cross-system validation
• Checking data quality, completeness, consistency and accuracy
• Identifying and analyzing discrepancies between source and target systems
• Validating complex data transformations and business rules

Test Planning & Execution:

• Analyze business and technical requirements
• Develop detailed test scenarios and test cases
• Create comprehensive test strategies
• Perform functional, integration, system and regression testing
• Monitor test coverage and quality throughout releases
• Ensure a structured end-to-end testing lifecycle
• Identify quality risks at an early stage and propose solutions

SQL & Data Analysis:

An important part of the role is performing advanced data analysis.

You will:

• Use advanced SQL for data validation
• Validate complex joins, aggregations and transformations
• Verify business rules within datasets
• Analyze source-to-target mappings
• Investigate data-related defects and inconsistencies
• Use SQL to identify the root cause of data quality issues

Test Automation:

Where possible, you will contribute to further automation of data validation.

You will preferably work with:

• Python
• PySpark
• Pandas

You will develop and maintain reusable automation utilities and frameworks to improve theefficiency, reliability and scalabilityof the testing process.

Cloud & Data Platform Testing:

You have experience testing modern cloud-based data platforms.

Within this role, you will work with technologies including:

• Azure Data Factory (ADF)
• Azure Databricks
• Azure Data Lake Gen2
• Azure DevOps

You will validate data pipelines and data processing solutions and ensure that different Azure services integrate correctly.

API & Integration Testing:

You will also be involved in testing data exchange between different applications and services.

You will:

• Perform API and integration testing
• Validate data exchange between systems
• Use tools such as Postman
• Verify the consistency and accuracy of data across different systems

Defect Management:

You will be responsible for the complete defect lifecycle:

• Identifying and documenting defects
• Analyzing root causes
• Prioritizing and following up on issues
• Collaborating with development and integration teams
• Verifying fixes
• Ensuring the correct closure of defects

Reporting & Stakeholder Management:

You will work closely with:

• Developers
• Data Engineers
• Data Architects
• Business Analysts
• Product Owners
• Business Users
• Project and Program Management

You will report on:

• Test progress
• Test results
• Quality metrics
• Risks
• Dependencies
• Blockers
• Outstanding defects

You are able to clearly translate technical findings into concrete business impact for business stakeholders.

Quality & Risk Management:

• Proactively identify quality risks
• Develop and monitor mitigation measures
• Ensure QA standards and processes are followed
• Contribute to quality governance
• Promote continuous improvement in testing and data quality

Must-Have

• Several years of experience as aSoftware Quality Engineer, Data QA Engineer, Data Test Engineer, ETL Test Engineeror in a similar role
• Demonstrable experience withETL Testing / Big Data Testing
• Strong experience with manual testing
• Experience with BI and reporting validation
• Advanced knowledge of SQL
• Experience with data validation and data reconciliation
• Experience with the complete end-to-end testing lifecycle
• Experience with Azure DevOps
• Good knowledge of ETL frameworks and processes
• Hands-on experience with:
  • Python
  • PySpark
  • Pandas
  • Azure Data Factory (ADF)
  • Azure Databricks
  • Azure Data Lake Gen2
  • Postman

Experience with these technologies is important for this role.

Education:

You hold aBachelor's or Master's degreein a field such as:

• Computer Science
• Information Technology
• Data Engineering
• Software Engineering

Or another comparable technical discipline.

Competencies:

• Analytical and a strong problem solver
• Highly accurate and quality-oriented
• Independent and proactive
• Strong in ownership and accountability
• An effective communicator
• Skilled in stakeholder management
• Able to explain complex technical information in an understandable way
• Strong in identifying and mitigating risks
• Comfortable working in a complex, data-driven environment

Ideal Profile:

The ideal candidate has a strong background indata-centric testingand experience working within modern, cloud-based data architectures.

You combine:

QA & Testing + ETL + SQL + Data Quality + Azure + Automation

You are also able to independently lead QA activities, coordinate multiple stakeholders and take ownership of the quality of end-to-end data pipelines.

Experience with, or a strong interest in,AI-driven testing and intelligent test automationis considered a strong advantage.

What We Offer

• A challenging procurement role within an international and growing organization;
• The opportunity to influence sourcing and procurement decisions across the business;
• A collaborative and diverse working environment;
• Exposure to complex supplier, stakeholder and procurement networks;
• The opportunity to contribute to procurement optimization and transformation initiatives;
• The possibility to work with a broad range of industries, services and business functions.

All our positions are open to both women and men and are, of course, open to people with disabilities.