IT Software Quality Engineer – ETL & Big Data

United States Digital Space LLC; Rotterdam; On-site; EUR 55,000 - 85,000; Full time

Job summary

United States Digital Space LLC is seeking an IT Software Quality Engineer to drive QA across complex data platforms and cloud ecosystems. The role focuses on ETL and Big Data testing, data validation, SQL, and test automation to ensure accuracy and reliability of end-to-end data pipelines.

You will plan and execute functional, integration, system, and regression tests, build automated validation frameworks in Python/PySpark, and validate data across Azure Data Factory, Databricks, and Data Lake

Qualifications

• Must-have: ETL Testing / Big Data Testing, Manual Testing, BI/Reporting Validation, Advanced SQL, Data Validation and Reconciliation, End-to-End Test Lifecycle Management, Azure DevOps, ETL Frameworks and Processes.
• Hands-on experience: Python, PySpark, Pandas, Azure Data Factory (ADF), Azure Databricks, Azure Data Lake Gen2, Postman.
• Bachelor's or Master's Degree in Computer Science, Information Technology, Data Engineering, or related technical discipline.
• Strong analytical and problem-solving skills are required.

Responsibilities

• Perform end-to-end testing of ETL and data workflows.
• Validate data extraction, transformation, and loading processes.
• Conduct data reconciliation and cross-system validation.
• Create test plans and execute functional, integration, system, and regression tests.
• Develop automated data validation frameworks using Python, PySpark, and Pandas.
• Test cloud data pipelines on Azure Data Factory, Databricks, and Data Lake Gen2.
• Validate data exchange across integrated applications and perform API testing with Postman.
• Manage defect lifecycle and report testing metrics to stakeholders.

Skills

ETL Testing

Big Data Testing

Manual Testing

BI/Reporting Validation

Advanced SQL

Data Validation & Reconciliation

End-to-End Test Lifecycle

Azure DevOps

ETL Frameworks

Python

PySpark

Pandas

Postman

Azure Data Factory

Azure Databricks

Azure Data Lake Gen2

Education

Bachelor's degree in Computer Science

Master's degree in Data Engineering

Tools

Postman

Azure Data Factory

Azure Databricks

Azure Data Lake Gen2

Python

SQL

Job description

United States Digital Space LLC is seeking an IT Software Quality Engineer to drive QA across complex data platforms and cloud ecosystems. The role focuses on ETL and Big Data testing, data validation, SQL, and test automation to ensure accuracy and reliability of end-to-end data pipelines.

You will plan and execute functional, integration, system, and regression tests, build automated validation frameworks in Python/PySpark, and validate data across Azure Data Factory, Databricks, and Data Lake