Data Engineer (Data Quality)

Ascendion Engineering; Pune District; Hybrid; INR 1,200,000 - 2,400,000; Full time

Job summary

Ascendion Engineering seeks a motivated Data Quality Engineer to join the data engineering team in Pune. You will build and maintain robust data quality frameworks, embed quality checks into pipelines, and support data-driven decision-making across platforms.

The role emphasizes Python/SQL, PySpark/Databricks, cloud platforms (Azure/AWS), data governance awareness, and collaboration with cross-functional teams to ensure data accuracy and reliability.

Qualifications

• Proficient in Python and SQL for data quality checks.
• Experience building data quality frameworks and ETL/ELT pipelines.
• Hands-on with PySpark and Databricks in cloud environments.
• Knowledge of Azure/AWS data platforms and data governance basics.
• Strong communication for cross-functional stakeholders.

Responsibilities

• Design and implement automated data quality checks and validation frameworks.
• Perform data profiling, anomaly detection, and root cause analysis using Python and SQL.
• Integrate data quality processes into ETL/ELT pipelines using PySpark and Databricks.
• Monitor and resolve data quality issues across Azure/AWS-based data platforms.
• Develop CI/CD pipelines for data quality automation using Git and DevOps tools.
• Work with JDBC connectors to validate data movement and integrity across systems.
• Document data quality rules, processes, and findings for technical and business stakeholders.

Skills

Python

SQL

Agile Experience

Analytical Thinking

Communication

Tools

PySpark

Databricks

Azure

AWS

JDBC

Git

CI/CD (GitHub Actions)

Airflow

PowerBI

Job description

Job Summary:

We are looking for a highly motivated Data Quality Engineer to join our data engineering team. The ideal candidate will be responsible for building and maintaining robust data quality frameworks to ensure the accuracy, consistency, and reliability of data across platforms. You will collaborate with cross-functional teams to embed quality checks into data pipelines and support data-driven decision-making.

Key Responsibilities:

• Design and implement automated data quality checks and validation frameworks.
• Perform data profiling, anomaly detection, and root cause analysis using Python and SQL.
• Integrate data quality processes into ETL/ELT pipelines using PySpark and Databricks.
• Monitor and resolve data quality issues across Azure/AWS-based data platforms.
• Develop CI/CD pipelines for data quality automation using Git and DevOps tools.
• Work with JDBC connectors to validate data movement and integrity across systems.
• Document data quality rules, processes, and findings for technical and business stakeholders.

Required Technical Skills:

• Programming Languages: Python, SQL
• Big Data Tools: PySpark, Databricks
• Cloud Platforms: Azure/AWS ("e.g., S3, Lambda")
• Data Connectivity: JDBC
• Version Control: Git
• DevOps: CI/CD tools (e.g. GitHub Actions), Airflow
• Data quality metrics visualization (e.g. PowerBI)

Soft Skills:

• Agile Experience: Proven experience working in Agile development environments.
• Analytical Thinking: Strong analytical and problem-solving abilities.
• Critical Thinking: Ability to evaluate data issues logically and propose effective, scalable solutions.
• Communication: Excellent communication skills for cross-team collaboration and stakeholder engagement.

Preferred Qualifications:

• Experience with data governance and metadata management tools.
• Familiarity with data cataloging solutions.
• Understanding of data privacy and compliance standards.