Remote Data Quality Engineer: Databricks & dbt

Cognizant; Lansing (MI); Remote; USD 70,000 - 117,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays and PTO

401(k) plan

Disability insurance

Parental leave

Employee stock purchase plan

Job summary

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer to ensure the accuracy, consistency, and reliability of enterprise data platforms. You will design and automate data quality tests using dbt, Python, and Databricks, and integrate quality controls into CI/CD pipelines with Azure DevOps.

In this role you will build automated tests in dbt, develop Python validation frameworks, validate Databricks pipelines, and monitor data quality metrics across source-to-target

Qualifications

• 5+ years in QA, data testing, or data engineering roles focused on data validation.
• Hands-on experience with dbt (Core or Cloud): tests, macros, models, documentation.
• Strong Python skills (pandas, PySpark, pytest) for test automation.
• Practical experience with Databricks: notebooks, jobs, Delta tables, Unity Catalog.
• Experience building Azure Pipelines for CI/CD.
• Solid understanding of data quality concepts, dimensions, and frameworks.
• Experience with Git and version-controlled development workflows.
• Experience in using GitHub Copilot.

Responsibilities

• Design, build, and maintain automated data quality tests in dbt (schema tests, custom generic tests, singular tests, source freshness checks).
• Develop Python-based validation frameworks and scripts for data reconciliation, schema drift detection, and regression testing.
• Validate data pipelines and transformations in Databricks (PySpark/SQL, Delta Lake), covering source-to-target mapping, row counts, aggregations, and business rules.
• Integrate data quality gates into Azure Pipelines, so builds and releases are blocked when tests fail.
• Define, monitor, and report on data quality metrics (completeness, accuracy, consistency, timeliness, uniqueness), and set up alerting for anomalies.
• Triage and root-cause data defects with data engineers, analysts, and product owners, and track them through to resolution.
• Write and maintain test plans, test cases, and data quality documentation.
• Contribute to data governance and quality standards, including data contracts and lineage awareness.

Skills

QA/Data testing

Python

PySpark

Test automation

Data validation

Git

Azure DevOps

Stakeholder collaboration

Data governance concepts

Tools

dbt

Databricks

Azure Pipelines

Delta Lake

Unity Catalog

GitHub Copilot

Job description

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer to ensure the accuracy, consistency, and reliability of enterprise data platforms. You will design and automate data quality tests using dbt, Python, and Databricks, and integrate quality controls into CI/CD pipelines with Azure DevOps.

In this role you will build automated tests in dbt, develop Python validation frameworks, validate Databricks pipelines, and monitor data quality metrics across source-to-target