Data Quality Engineer

Forward Eye Technologies; Pune District; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

Forward Eye Technologies in Pune, India seeks a Data Quality Engineer (Data QE) to design and execute tests for data pipelines and analytics platforms. You will apply QE principles to ETL processes, ensure data accuracy, and collaborate with data engineers and product teams.

The ideal candidate has 6+ years in QE, hands-on ETL and database testing, and strong Python, PySpark, SQL and Databricks experience, with cloud data platform familiarity and CI/CD awareness.

Qualifications

• 6+ years of experience in Quality Engineering and QE processes.
• 2-3 years of hands-on ETL testing and database testing.
• 2-3 years of experience with Python and PySpark for data testing and automation.
• 2-3 years of experience in writing complex SQL queries for data validation.
• Experience with Databricks or similar big data platforms.

Responsibilities

• Design and implement end-to-end test strategies for data pipelines and ETL processes.
• Conduct thorough ETL and database testing to ensure data accuracy, completeness, and consistency.
• Develop automation frameworks and scripts using Python and PySpark.
• Perform data validation and integrity checks using advanced SQL queries.
• Work with big data platforms such as Databricks for testing and validation.
• Collaborate closely with data engineers, analysts, and product teams to understand data requirements.
• Identify data quality issues, troubleshoot, and work with stakeholders to resolve them.
• Document test cases, results, and provide regular status updates.

Skills

Quality Engineering

ETL testing

Python

PySpark

SQL

Databricks

Education

Bachelor's or Master's in Computer Science / Information Systems

Tools

CI/CD tools

Job description

Job Title : Data Quality Engineer (Data QE)

We are seeking a skilled and experienced Data Quality Engineer (Data QE) to join our team. The ideal candidate will have a strong background in Quality Engineering, ETL and database testing, and hands-on expertise with Python, PySpark, SQL, and Databricks. You will be responsible for designing and executing tests to ensure the quality and reliability of data pipelines and analytics platforms.

Key Responsibilities :

• Design and implement end-to-end test strategies for data pipelines and ETL processes.
• Conduct thorough ETL and database testing to ensure data accuracy, completeness, and consistency.
• Develop automation frameworks and scripts using Python and PySpark.
• Perform data validation and integrity checks using advanced SQL queries.
• Work with big data platforms such as Databricks for testing and validation.
• Collaborate closely with data engineers, analysts, and product teams to understand data requirements.
• Identify data quality issues, troubleshoot, and work with stakeholders to resolve them.
• Document test cases, results, and provide regular status updates.

Mandatory Skills & Experience :

• 6+ years of experience in Quality Engineering and QE processes.
• 2-3 years of hands-on experience in ETL testing and database testing.
• 2-3 years of experience with Python and PySpark for data testing and automation.
• 2-3 years of experience in writing complex SQL queries for data validation.
• Experience working with Databricks or similar big data platforms.

Preferred Qualifications :

• Experience with cloud data platforms (e.g., AWS, Azure, GCP).
• Familiarity with CI/CD pipelines and test automation tools.
• Knowledge of data governance and data quality frameworks.

Education :

Bachelors or Masters degree in Computer Science, Information Systems, or a related field.