Data Quality Engineer Data QE

Anblicks Inc.

Hyderabad

On-site

INR 1,800,000 - 2,800,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Anblicks Hyderabad is seeking a Data Quality Engineer with 5+ years of experience to ensure data accuracy across complex pipelines using Databricks and Snowflake.

You will design data quality tests, implement automated validation, and integrate tests into CI/CD workflows, collaborating with data engineers and expanding AI-assisted testing capabilities.

Strong SQL and Python skills, experience with ETL/ELT testing, and familiarity with Delta Lake and data models are required.

Qualifications

  • 5+ years of experience in data quality engineering or similar roles.
  • Strong SQL skills with complex joins, window functions, and aggregations.
  • Experience validating end-to-end data pipelines and data models.
  • Familiarity with ETL/ELT testing and data integrity checks.
  • Experience with CI/CD and test automation frameworks.
  • Exposure to Databricks and cloud data platforms is desirable.

Responsibilities

  • Design and execute data quality testing strategies for end-to-end data pipelines.
  • Perform ETL/ELT testing, source-to-target validation, data reconciliation, and business rule verification.
  • Develop advanced SQL queries and Python scripts for data validation and test automation.
  • Validate Databricks workflows, Delta tables, and Bronze, Silver, and Gold data layers.
  • Test incremental loads, CDC, schema changes, data integrity, and failure-recovery scenarios.
  • Build reusable, configuration-driven data quality automation frameworks.
  • Integrate automated tests into CI/CD pipelines and workflow orchestration tools.
  • Investigate data discrepancies, perform root cause analysis, and collaborate with data engineering teams.
  • Leverage AI-assisted tools to improve test case generation, SQL development, and failure analysis.

Skills

SQL
Python
PySpark
ETL/ELT testing
Test automation
Data validation
Data quality
CI/CD integration
Databricks
Snowflake

Tools

Databricks
Snowflake
Delta Lake
Unity Catalog
Airflow
Git
Jenkins
Azure DevOps

Job description

Job Title: Data Quality Engineer (Data QE)
Location: Hyderabad, India
Experience: 5+ Years
Company: Anblicks
About Anblicks

Anblicks is a Great Place to Work® Certified™ Data and AI company, helping enterprises accelerate digital transformation through modern data platforms, cloud engineering, analytics, and AI-driven solutions.

Role Overview

We are looking for a skilled Data Quality Engineer with strong expertise in SQL, Python, ETL/ELT testing, and data test automation. The candidate will ensure data accuracy, integrity, and reliability across complex data pipelines using modern platforms such as Databricks and Snowflake. Exposure to Generative AI, LLMs, RAG pipelines, and AI agents is an added advantage.

Key Responsibilities
  • Design and execute data quality testing strategies for end-to-end data pipelines.
  • Perform ETL/ELT testing, source-to-target validation, data reconciliation, and business rule verification.
  • Develop advanced SQL queries and Python scripts for data validation and test automation.
  • Validate Databricks workflows, Delta tables, and Bronze, Silver, and Gold data layers.
  • Test incremental loads, CDC, schema changes, data integrity, and failure-recovery scenarios.
  • Build reusable, configuration-driven data quality automation frameworks.
  • Integrate automated tests into CI/CD pipelines and workflow orchestration tools.
  • Investigate data discrepancies, perform root cause analysis, and collaborate with data engineering teams.
  • Leverage AI-assisted tools to improve test case generation, SQL development, and failure analysis.
Required Technical Skills
SQL & Python
  • Strong SQL skills, including complex joins, CTEs, window functions, and aggregations.
  • Proficiency in Python for data validation, reconciliation, and automation.
  • Exposure to PySpark for large-scale data processing and validation.
Data Quality & Engineering
  • Strong understanding of ETL/ELT testing, data warehousing, data modelling, and data profiling.
  • Experience with source-to-target validation, business rules, and data integrity checks.
  • Knowledge of batch/streaming pipelines and formats such as JSON, CSV, and Parquet.
Databricks & Cloud Platforms
  • Hands-on experience with Databricks notebooks, Spark SQL, jobs, and workflows.
  • Knowledge of Delta Lake, schema evolution, and Medallion Architecture.
  • Exposure to Snowflake, Unity Catalog, and cloud data platforms is desirable.
Automation & CI/CD
  • Experience building reusable SQL/Python-based test automation frameworks.
  • Knowledge of PyTest or similar testing frameworks.
  • Experience with Git, Jenkins, Azure DevOps, or equivalent CI/CD tools.
  • Familiarity with Databricks Workflows or Apache Airflow.
AI & Emerging Technologies
  • Understanding of Generative AI, LLMs, and AI-assisted testing.
  • Exposure to RAG pipeline validation, including document quality, metadata, retrieval relevance, and response accuracy.
  • Familiarity with LLM evaluation, AI agents, and responsible AI practices is an advantage.
Good to Have
  • Experience with Great Expectations, Soda, or Deequ.
  • Knowledge of Kafka, data observability, and anomaly detection.
  • Exposure to AWS, Azure, GCP, RAG evaluation tools, and data governance.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Quality Engineer (Data QE)
Data Quality Engineer (Data QE)

Anblicks Inc. • Hyderabad

On-site
INR 1,500,000 - 2,400,000
Data Quality Engineer (Data QE)
Data Quality Engineer (Data QE)

Anblicks Inc. • Hyderabad

On-site
INR 1,500,000 - 2,100,000
Data Quality Engineer
Data Quality Engineer

Forward Eye Technologies • Dadri

On-site
INR 1,500,000 - 2,500,000
Data Quality Engineer
Data Quality Engineer

Forward Eye Technologies • Pune District

On-site
INR 1,500,000 - 3,000,000
Data Quality Engineer - Python / ETL
Data Quality Engineer - Python / ETL

Forward Eye Technologies • Dadri

On-site
INR 1,500,000 - 2,700,000
Data Quality Engineer - Python/ETL
Data Quality Engineer - Python/ETL

Forward Eye Technologies • Pune District

On-site
INR 1,800,000 - 3,000,000
Data Quality Analyst
Data Quality Analyst

Mployee.me • Bengaluru

On-site
INR 1,200,000 - 1,800,000
Data Quality Analyst
Data Quality Analyst

Ness Digital Engineering • Bengaluru

Hybrid
INR 1,500,000 - 2,300,000
Senior Data Quality Engineer
Senior Data Quality Engineer

EPAM Systems Inc • Chennai District

On-site
INR 900,000 - 1,300,000
Senior Data Quality Engineer
Senior Data Quality Engineer

EPAM Systems Inc • Coimbatore District

On-site
INR 1,500,000 - 2,100,000