Remote Data Quality Engineer - Databricks & dbt

Cognizant; City of Albany (NY); Remote; USD 70,000 - 117,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays plus Paid Time Off

401(k) plan and contributions

Long-term/Short-term Disability

Paid Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer to ensure the accuracy, consistency, and reliability of enterprise data platforms. The role focuses on designing automated data quality tests in dbt, Python, and Databricks, and integrating quality controls into CI/CD pipelines through Azure DevOps.

You will partner with data engineers, analysts, and stakeholders to identify data issues, monitor quality metrics, and drive improvements across the data ecosystem.

Qualifications

• 5+ years in QA, data testing, or data engineering with data validation focus.
• Hands-on with dbt (Core or Cloud): tests, macros, models, docs.
• Strong Python skills (pandas, PySpark, pytest) for test automation.
• Experience with Databricks notebooks, jobs, Delta tables, and Unity Catalog.
• Azure Pipelines (Azure DevOps) for CI/CD experience.
• Solid understanding of data quality concepts and frameworks.
• Experience with Git and version-controlled workflows.
• Experience using GitHub Copilot.

Responsibilities

• Design, build, and maintain automated data quality tests in dbt.
• Develop Python-based validation frameworks for data reconciliation and regression testing.
• Validate data pipelines in Databricks (PySpark/SQL, Delta Lake).
• Integrate data quality gates into Azure Pipelines to block failed builds.
• Define, monitor, and report data quality metrics and alerts.
• Triage data defects with engineers, analysts, and product owners.
• Write and maintain test plans, test cases, and data quality docs.
• Contribute to data governance and quality standards, including data contracts and lineage.

Skills

Quality assurance

Data testing

Data validation

Python

PySpark

dbt

Databricks

Azure DevOps

Git

GitHub Copilot

Test automation

Tools

dbt Core/Cloud

Python

Databricks

Azure Pipelines

Git

GitHub Copilot

Pandas

PySpark

Delta Lake

Unity Catalog

Job description

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer to ensure the accuracy, consistency, and reliability of enterprise data platforms. The role focuses on designing automated data quality tests in dbt, Python, and Databricks, and integrating quality controls into CI/CD pipelines through Azure DevOps.

You will partner with data engineers, analysts, and stakeholders to identify data issues, monitor quality metrics, and drive improvements across the data ecosystem.