Remote Data Quality Engineer - Databricks, dbt & CI/CD

Cognizant; Jackson (MS); Remote; USD 70,000 - 117,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays plus Paid Time Off

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer (Databricks & dbt) to design and automate data quality testing frameworks. The role emphasizes validating data pipelines, integrating quality gates into Azure Pipelines, and reporting key data quality metrics.

The position is remote in the USA, offering flexibility and a focus on collaboration with data engineers, analysts, and product owners to ensure data accuracy and reliability across enterprise platforms.

Qualifications

• 5+ years in QA, data testing, or data engineering with a focus on data validation.
• Hands-on experience with dbt (Core or Cloud): tests, macros, models, documentation.
• Strong Python skills (pandas, PySpark, pytest) for test automation.
• Practical experience with Databricks: notebooks, jobs, Delta tables, Unity Catalog.
• Experience building and maintaining Azure Pipelines (Azure DevOps) for CI/CD.
• Solid understanding of data quality concepts, dimensions, and frameworks.
• Experience with Git and version-controlled development workflows.
• Experience in using GitHub Copilot.

Responsibilities

• Design, build, and maintain automated data quality tests in dbt (schema tests, custom tests, singular tests, source freshness checks).
• Develop Python-based validation frameworks and scripts for data reconciliation, schema drift detection, and regression testing.
• Validate data pipelines and transformations in Databricks (PySpark/SQL, Delta Lake).
• Integrate data quality gates into Azure Pipelines to block builds/releases when tests fail.
• Define, monitor, and report on data quality metrics and set up anomaly alerts.
• Triage and root-cause data defects with data engineers and product owners to resolution.
• Write and maintain test plans, test cases, and data quality documentation.
• Contribute to data governance and quality standards, including data contracts and lineage awareness.

Skills

5+ years in QA/data testing

Python programming

Git version control

GitHub Copilot

Education

Bachelor's degree or higher (related field)

Tools

dbt

Databricks

Azure DevOps

PySpark

SQL

Delta Lake

Git

Python

pandas

pytest

Unity Catalog

Job description

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer (Databricks & dbt) to design and automate data quality testing frameworks. The role emphasizes validating data pipelines, integrating quality gates into Azure Pipelines, and reporting key data quality metrics.

The position is remote in the USA, offering flexibility and a focus on collaboration with data engineers, analysts, and product owners to ensure data accuracy and reliability across enterprise platforms.