Senior Data QA Engineer - Remote Data Quality & Pipelines

R3 Consultant; United States; Remote; USD 16,000 - 31,000; Full time

Job summary

R3 Consultant is seeking an experienced Sr. QA Data Engineer to own the quality of data pipelines and data-driven systems, working with Data Engineers, Software Engineers, and Analysts to ensure data integrity across sources and stages.

The role emphasizes hands-on testing of ETL/ELT processes, SQL validation, and automation using Python, Spark, Databricks, and Delta Lake, in a remote India setting with IST shift timings.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field.
• 5+ years of QA/testing experience, preferably working with Data Engineering, Big Data, or data-intensive applications.
• Strong hands-on ETL/ELT testing and data validation.
• Experience with Apache Spark/PySpark and Databricks.
• Excellent English communication and problem-solving skills.

Responsibilities

• Design and execute functional, integration, regression, and end-to-end testing for data pipelines and platforms.
• Validate ETL/ELT workflows, data transformations, and source-to-target data accuracy.
• Test Spark/PySpark, Databricks, and Delta Lake workflows.
• Perform SQL-based data validation and data reconciliation.
• Develop Python-based test automation for data validation and regression.
• Collaborate with Data Engineers, Analysts, Data Scientists and Product teams.
• Maintain test cases, automation suites, and release validation.

Skills

Data Testing

ETL/ELT Testing

SQL

Python

Apache Spark

Databricks

Delta Lake

Data Validation

APIs Testing

Linux/Unix

Shell Scripting

Git

CI/CD QA

Agile/Scrum

Troubleshooting

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or a related field

Tools

Databricks

Delta Lake

Apache Spark

PySpark

Job description

R3 Consultant is seeking an experienced Sr. QA Data Engineer to own the quality of data pipelines and data-driven systems, working with Data Engineers, Software Engineers, and Analysts to ensure data integrity across sources and stages.

The role emphasizes hands-on testing of ETL/ELT processes, SQL validation, and automation using Python, Spark, Databricks, and Delta Lake, in a remote India setting with IST shift timings.