Sr. Data QA Engineer

Astegic Inc.; India; Remote; INR 1,500,000 - 2,500,000; Full time

Job summary

SalesIntel is seeking an experienced Sr. QA Data Engineer to own the quality and reliability of data pipelines and data-driven systems.

You will validate complex data transformations, run end-to-end testing, and automate data validation in Python/SQL across ETL/ELT workflows. You will collaborate with Data Engineers, Software Engineers, Analysts, Data Scientists, and Product teams to ensure data accuracy and timely delivery to downstream consumers in a remote Pan India setup.

Qualifications

• Bachelor’s degree in CS, Engineering, IT, or related field.
• 5+ years in QA/testing for data/Big Data or data-intensive apps.
• Strong ETL/ELT and database testing experience.
• Advanced SQL skills: joins, subqueries, CTEs, window functions, reconciliations.
• Experience testing Spark/PySpark data workflows.
• Experience with Databricks and Delta Lake.
• Knowledge of data lakes, lakehouse, data warehousing.
• Proficient Python for test automation.
• API/integration testing experience.
• Linux/Unix & shell scripting familiarity.
• Agile/Scrum environment experience.
• Strong analytical and problem-solving skills.

Responsibilities

• Design and execute functional, integration, regression, and end-to-end testing for data pipelines and data platforms.
• Validate ETL/ELT workflows, data transformations, business rules, and source-to-target data accuracy.
• Test Apache Spark/PySpark data processing workflows.
• Perform advanced SQL-based data validation, reconciliation, and data-quality testing.
• Validate data for accuracy, completeness, consistency, uniqueness, integrity, and schema compliance.
• Test APIs and integrations across data sources, databases, pipelines, and downstream systems.
• Develop and maintain Python/SQL-based test automation for data validation and regression testing.
• Design and execute positive, negative, edge-case, failure, retry, and recovery scenarios across data workflows.
• Investigate data discrepancies and work with cross-functional teams to resolve issues.
• Review requirements and data flows to identify QA risks and coverage gaps early.
• Maintain test cases, automation suites, defect docs, and release validation.
• Drive continuous improvement of QA processes and data quality.

Skills

SQL

Python

Apache Spark

Databricks

Delta Lake

ETL/ELT Testing

Data Validation

Linux Shell

Education

Bachelor’s degree in CS/Engineering/IT

Tools

Databricks

Delta Lake

Git

CI/CD

Job description

Position Overview:

We are looking for an experienced Sr. QA Data Engineer to join our Data Engineering team and take ownership of the quality, accuracy, consistency, and reliability of our data pipelines and data-driven systems.

The ideal candidate will have strong hands‑on experience in Data Testing, ETL/ELT Testing, Database Testing, SQL, Python, Apache Spark, and Databricks. The candidate should be comfortable validating complex data transformations, investigating data discrepancies, and testing end-to-end data workflows across multiple sources, processing layers, and downstream systems.

You will work closely with Data Engineers, Software Engineers, Database Architects, Data Analysts, Data Scientists, and Product teams to ensure data is processed correctly and delivered reliably to downstream consumers.

This role requires strong analytical and problem‑solving skills, attention to detail, and the ability to independently understand complex data flows, develop comprehensive test strategies, automate data validation, investigate defects, and drive quality across the data engineering ecosystem.

What You’ll Be Doing:

• Design and execute functional, integration, regression, and end‑to‑end testing for data pipelines and data platforms.
• Validate ETL/ELT workflows, data transformations, business rules, and source‑to‑target data accuracy.
• Test Apache Spark/PySpark, Databricks, and Delta Lake data processing workflows.
• Perform advanced SQL‑based data validation, reconciliation, and data‑quality testing.
• Validate data for accuracy, completeness, consistency, uniqueness, integrity, and schema compliance.
• Test APIs and integrations across data sources, databases, pipelines, and downstream systems.
• Develop and maintain Python/SQL‑based test automation for data validation and regression testing.
• Design and execute positive, negative, edge‑case, failure, retry, and recovery scenarios across data workflows.
• Investigate data discrepancies and work with Data Engineers, Developers, Analysts, and Data Scientists to identify root causes and resolve issues.
• Review requirements, technical designs, and data flows to identify QA risks, dependencies, and coverage gaps early in the development lifecycle.
• Maintain comprehensive test cases, automation suites, defect documentation, test evidence, and release validation for assigned data products.
• Drive continuous improvement of QA processes, data validation frameworks, automation coverage, and overall data quality.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, Information Technology, or a related field.
• 5+ years of relevant QA/testing experience, preferably working with Data Engineering, Big Data, or data‑intensive applications.
• Strong hands‑on experience in ETL/ELT testing, database testing, and data validation.
• Advanced SQL skills, including complex joins, subqueries, CTEs, window functions, aggregations, and data reconciliation.
• Practical experience testing Apache Spark/PySpark data processing workflows.
• Hands‑on experience with Databricks and Delta Lake.
• Strong understanding of Big Data concepts, distributed data processing, data pipelines, and data architecture.
• Experience validating Parquet, JSON, CSV, and other structured and semi‑structured data formats.
• Strong programming/scripting skills in Python for test automation and data validation.
• Experience with API and integration testing.
• Working knowledge of Linux/Unix environments and shell scripting.
• Understanding of Data Lakes, Lakehouse architecture, Data Warehousing, and ETL/ELT pipelines.
• Experience with Git, defect management tools, and CI/CD‑based testing workflows.
• Experience working in an Agile/Scrum environment.
• Strong analytical, troubleshooting, and root‑cause analysis skills.
• Ability to work independently, take ownership, and collaborate effectively with cross‑functional teams.
• Excellent written and verbal communication skills in English.

REPORTING:

This position will report to the Sr. Technical Manager or Director of Engineering, as assigned by Management.

EMPLOYMENT TYPE:

Full‑Time, Permanent

LOCATION:

Remote – Pan India

SHIFT TIMINGS:

11:00 AM – 08:00 PM IST

WHO WE ARE:

SalesIntel is an agentic pipeline generation platform that helps go‑to‑market teams focus on accounts that are ready to buy and the buyers who matter most. We enable thousands of users by turning buying signals into actionable insights that drive revenue.
For more information, please visit – https://www.salesintel.io/

What We Offer:

At SalesIntel, we value diversity, collaboration, and continuous growth. Our workforce represents different countries and cultures, creating an inclusive and dynamic environment where people can learn, contribute, and grow.

We offer a range of benefits, including:

• Holidays and Paid Leaves
• Bonuses and Incentives
• Medical Insurance
• Company-sponsored Training and Development Programs
• Opportunities for professional growth in a fast‑paced technology environment

Equal Opportunity Employer.

We prohibit discrimination and harassment of any type and provide equal employment opportunities to all employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by applicable law