Remote Data Quality Engineer (Databricks + dbt)

Cognizant; Providence (RI); Remote; USD 70,000 - 117,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays + PTO

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant Technology Solutions Corporation is hiring a Data Quality Engineer to design and automate data quality testing using dbt, Python, and Databricks. The role emphasizes CI/CD integration via Azure DevOps and close collaboration with data engineers and stakeholders.

The candidate will implement tests for schema validation, data reconciliation, and governance, while monitoring quality metrics and alerting on anomalies across cloud data platforms.

Qualifications

• 5+ years in QA, data testing or data engineering focusing on data validation.
• Hands-on experience with dbt (Core or Cloud): tests, macros, models, documentation.
• Strong Python skills (pandas, PySpark, pytest) for test automation.
• Practical experience with Databricks: notebooks, jobs, Delta tables, Unity Catalog.
• Experience building and maintaining Azure Pipelines (Azure DevOps) for CI/CD.
• Solid understanding of data quality concepts, dimensions, and frameworks.
• Experience with Git and version-controlled development workflows.
• Experience in using GitHub Copilot.

Responsibilities

• Design, build, and maintain automated data quality tests in dbt (schema tests, custom tests, source freshness checks).
• Develop Python-based validation frameworks and scripts for data reconciliation and regression testing.
• Validate data pipelines in Databricks (PySpark/SQL, Delta Lake) for source-to-target mapping and rules.
• Integrate data quality gates into Azure Pipelines to block failing builds/releases.
• Define, monitor, and report data quality metrics; set up anomaly alerts.
• Triage and root-cause data defects with cross-functional teams; track to resolution.
• Write and maintain test plans, test cases, and data quality docs.
• Contribute to data governance and quality standards, including data contracts and lineage.

Skills

QA experience

Data testing

Data validation

Python

PySpark

Test automation

Git

Tools

dbt

Databricks

Azure DevOps

Delta Lake

GitHub Copilot

Job description

Cognizant Technology Solutions Corporation is hiring a Data Quality Engineer to design and automate data quality testing using dbt, Python, and Databricks. The role emphasizes CI/CD integration via Azure DevOps and close collaboration with data engineers and stakeholders.

The candidate will implement tests for schema validation, data reconciliation, and governance, while monitoring quality metrics and alerting on anomalies across cloud data platforms.