Senior Quality Engineer

Ixiegaming; Ernakulam; On-site; INR 900,000 - 1,800,000; Full time

Job summary

Indium is seeking a data quality engineer in Kerala, India to validate end-to-end data pipelines and ensure governance across ingestion, transformation, and consumption layers. You will design ETL automation with Python and Pytest, perform source-to-target validation, and monitor data quality using DataGaps in cloud architectures.

You will collaborate with data engineers, architects and product teams, validate ETL workflows, and integrate automated tests into CI/CD pipelines.

Qualifications

• Strong experience in data pipeline validation and ETL testing.
• Proficiency in Python, PySpark, SQL, and Pytest.
• Experience with DataGaps and Selenium frameworks.
• Familiarity with CI/CD tools (GitHub Actions) and Git.
• Experience with AWS Glue/Iceberg and lakehouse architectures.
• Knowledge of test data management and JMeter performance testing.
• Experience with Zephyr for test management and Jira for issue tracking.

Responsibilities

• Own end-to-end data quality validation across ingestion, transformation and consumption layers.
• Design and maintain ETL automation frameworks using Python and Pytest.
• Perform source-to-target validation, reconciliation and anomaly detection.
• Validate cloud-based data architectures (data lakes, warehouses, streaming platforms).
• Implement data quality rules such as null checks and schema validation.
• Use DataGaps or similar tools for data quality monitoring.
• Collaborate with data engineers, architects and product teams to ensure quality.
• Validate ETL workflows, scheduling and failure handling.
• Execute SQL and Python-based validations for batch and real-time data.
• Integrate automated data tests into CI/CD pipelines.
• Track and report defects using Zephyr and Jira.
• Ensure compliance with data governance and regulatory standards.
• Mentor junior engineers and contribute to best practices and frameworks.

Skills

data pipeline validation

ETL testing

data quality engineering

Python

PySpark

SQL

Pytest

Selenium

CI/CD

GitHub Actions

AWS

Docker

Kubernetes

JMeter

Zephyr

Jira

Education

Bachelor’s degree in Computer Science, Engineering, or related field

Tools

Git

GitHub Actions

DataGaps

Tableau (preferred)

Tableau APIs

Job description

• Own end-to-end data quality validation across ingestion, transformation, and consumption layers
• Design and maintain ETL automation frameworks using Python and Pytest
• Perform source-to-target validation, reconciliation, and anomaly detection
• Validate cloud-based data architectures (data lakes, warehouses, streaming platforms)
• Implement data quality rules such as null checks, schema validation, and integrity checks
• Use DataGaps (preferred) or similar tools for data quality monitoring
• Collaborate with data engineers, architects, and product teams to ensure quality
• Validate ETL workflows, scheduling, and failure handling mechanisms
• Execute SQL and Python-based validations for batch and real-time data
• Integrate automated data tests into CI/CD pipelines
• Track and report defects using Zephyr and Jira
• Ensure compliance with data governance and regulatory standards
• Mentor junior engineers and contribute to best practices and frameworks

Required Skills:

• Strong experience in data pipeline validation, ETL testing, and data quality engineering
• Proficiency in Python, PySpark, SQL, and Pytest
• Experience with Selenium and DataGaps frameworks
• Knowledge of CI/CD tools (GitHub Actions) and version control (Git)
• Experience with AWS (Glue, Iceberg) and lakehouse architectures
• Familiarity with test data management techniques
• Experience with performance testing tools (JMeter)
• Experience with Zephyr test management tool
• Knowledge of Docker and Kubernetes

Preferred:

• Experience with healthcare or regulated datasets
• Experience validating APIs, Tableau reports, and UI
• Familiarity with Agile methodologies

Education:

• Bachelor’s degree in Computer Science, Engineering, or related field

At Indium, diversity, equity, and inclusion (DEI) are core values. We promote DEI through a dedicated council, expert sessions, and tailored training, fostering an inclusive workplace. Our initiatives, like the WE@IN women empowerment program and DEI calendar, create a culture of respect and belonging. Recognized with the Human Capital Award, we're committed to an environment where everyone thrives. Join us in building a diverse, innovative workplace.

Indium do not solicit or accept any form of fees or payment at any stage of the hiring process.