Senior Quality Engineer

indiumsoft; Ernakulam; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Indiumsoft seeks a Senior Data Quality Engineer with 6–8 years of experience to own end-to-end data quality validation across ingestion, transformation, and consumption layers. You will design ETL automation with Python and Pytest, perform source-to-target validation, and ensure quality across cloud data architectures.

The role requires strong Python, PySpark, SQL, Selenium, and DataGaps experience, plus familiarity with CI/CD, Docker, and Kubernetes.

Qualifications

• Strong experience in data pipeline validation, ETL testing, and data quality engineering.
• Proficiency in Python, PySpark, SQL, and Pytest.
• Experience with Selenium and DataGaps frameworks.
• Knowledge of CI/CD tools (GitHub Actions) and version control (Git).
• Experience with AWS (Glue, Iceberg) and lakehouse architectures.
• Familiarity with test data management techniques.
• Experience with performance testing tools (JMeter).
• Experience with Zephyr test management tool.
• Knowledge of Docker and Kubernetes.

Responsibilities

• Own end-to-end data quality validation across ingestion, transformation, and consumption layers.
• Design and maintain ETL automation frameworks using Python and Pytest.
• Perform source-to-target validation, reconciliation, and anomaly detection.
• Validate cloud-based data architectures (data lakes, warehouses, streaming platforms).
• Implement data quality rules such as null checks, schema validation, and integrity checks.
• Use DataGaps (preferred) or similar tools for data quality monitoring.
• Collaborate with data engineers, architects, and product teams to ensure quality.
• Validate ETL workflows, scheduling, and failure handling mechanisms.
• Execute SQL and Python-based validations for batch and real-time data.
• Integrate automated data tests into CI/CD pipelines.
• Track and report defects using Zephyr and Jira.
• Ensure compliance with data governance and regulatory standards.
• Mentor junior engineers and contribute to best practices and frameworks.

Skills

Data pipeline validation

ETL testing

Python

PySpark

SQL

Pytest

Selenium

DataGaps

Git

AWS

Glue

Iceberg

CI/CD

Docker

Kubernetes

JMeter

Zephyr

Jira

Education

Bachelor's degree in Computer Science/Engineering

Tools

GitHub Actions

DataGaps

Selenium

Zephyr

Jira

Job description

Job Title: Senior Data Quality Engineer Experience: 6–8 Years

Job Description

• Own end-to-end data quality validation across ingestion, transformation, and consumption layers
• Design and maintain ETL automation frameworks using Python and Pytest
• Perform source-to-target validation, reconciliation, and anomaly detection
• Validate cloud-based data architectures (data lakes, warehouses, streaming platforms)
• Implement data quality rules such as null checks, schema validation, and integrity checks
• Use DataGaps (preferred) or similar tools for data quality monitoring
• Collaborate with data engineers, architects, and product teams to ensure quality
• Validate ETL workflows, scheduling, and failure handling mechanisms
• Execute SQL and Python-based validations for batch and real-time data
• Integrate automated data tests into CI/CD pipelines
• Track and report defects using Zephyr and Jira
• Ensure compliance with data governance and regulatory standards
• Mentor junior engineers and contribute to best practices and frameworks

Required Skills

• Strong experience in data pipeline validation, ETL testing, and data quality engineering
• Proficiency in Python, PySpark, SQL, and Pytest
• Experience with Selenium and DataGaps frameworks
• Knowledge of CI/CD tools (GitHub Actions) and version control (Git)
• Experience with AWS (Glue, Iceberg) and lakehouse architectures
• Familiarity with test data management techniques
• Experience with performance testing tools (JMeter)
• Experience with Zephyr test management tool
• Knowledge of Docker and Kubernetes

Preferred

• Experience with healthcare or regulated datasets
• Experience validating APIs, Tableau reports, and UI
• Familiarity with Agile methodologies

Education

• Bachelor’s degree in Computer Science, Engineering, or related field