Data Quality Engineer: Databricks & dbt in CI/CD

Cognizant

Frankfort (KY)

Remote

USD 70,000 - 117,000

Full time

11 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer to design, automate, and maintain data quality tests across enterprise data platforms. You will implement tests in dbt, validate pipelines in Databricks, and integrate quality gates into Azure DevOps pipelines to prevent faulty builds.

You will monitor quality metrics and collaborate with data engineers, analysts, and stakeholders to drive continuous improvements, governance, and lineage awareness while supporting a

Qualifications

  • 5+ years in QA, data testing, or data engineering roles with a focus on data validation.
  • Hands-on experience with dbt (Core or Cloud): tests, macros, models, documentation.
  • Strong Python skills (pandas, PySpark, pytest) for test automation.
  • Practical experience with Databricks: notebooks, jobs, Delta tables, Unity Catalog.
  • Experience building and maintaining Azure Pipelines (Azure DevOps) for CI/CD.
  • Solid understanding of data quality concepts, dimensions, and frameworks.
  • Experience with Git and version-controlled development workflows.
  • Experience in using GitHub copilot

Responsibilities

  • esign, build, and maintain automated data quality tests in dbt (schema tests, custom generic tests, singular tests, source freshness checks).
  • Develop Python-based validation frameworks and scripts for data reconciliation, schema drift detection, and regression testing.
  • Validate data pipelines and transformations in Databricks (PySpark/SQL, Delta Lake), covering source-to-target mapping, row counts, aggregations, and business rules.
  • Integrate data quality gates into Azure Pipelines, so builds and releases are blocked when tests fail.
  • Define, monitor, and report on data quality metrics (completeness, accuracy, consistency, timeliness, uniqueness), and set up alerting for anomalies.
  • Triage and root-cause data defects with data engineers, analysts, and product owners, and track them through to resolution.
  • Write and maintain test plans, test cases, and data quality documentation.
  • Contribute to data governance and quality standards, including data contracts and lineage awareness.

Skills

QA & data testing
Python programming
Data validation

Tools

dbt
Databricks
Azure DevOps
PySpark
Delta Lake
Git
GitHub Copilot

Job description

Cognizant Technology Solutions Corporation is seeking a Data Quality Engineer to design, automate, and maintain data quality tests across enterprise data platforms. You will implement tests in dbt, validate pipelines in Databricks, and integrate quality gates into Azure DevOps pipelines to prevent faulty builds.

You will monitor quality metrics and collaborate with data engineers, analysts, and stakeholders to drive continuous improvements, governance, and lineage awareness while supporting a

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Data Quality Engineer — Databricks, dbt & CI/CD
Remote Data Quality Engineer — Databricks, dbt & CI/CD

Cognizant Technology Solutions Corporation • Princeton (NJ)

Remote
USD 70,000 - 117,000
Medical Insurance
Dental Insurance
Vision Insurance
+7
Remote Data Quality Engineer - Databricks, dbt & CI/CD
Remote Data Quality Engineer - Databricks, dbt & CI/CD

Cognizant • Jackson (MS)

Remote
USD 70,000 - 117,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
Remote Data Quality Engineer: Databricks & dbt
Remote Data Quality Engineer: Databricks & dbt

Cognizant • Richmond (VA)

Remote
USD 70,000 - 117,000
Medical/Dental/Vision/Life Insurance
Paid holidays and PTO
401(k) plan and contributions
+3
Remote Data Quality Engineer (Databricks & dbt)
Remote Data Quality Engineer (Databricks & dbt)

Cognizant • Annapolis (MD)

Remote
USD 70,000 - 117,000
Data Quality Engineer (Databricks & dbt)
Data Quality Engineer (Databricks & dbt)

Cognizant Technology Solutions Corporation • Princeton (NJ)

Remote
USD 70,000 - 117,000
Medical Insurance
Dental Insurance
Vision Insurance
+7
Data Quality Engineer (Databricks & dbt)
Data Quality Engineer (Databricks & dbt)

Cognizant • Richmond (VA)

Remote
USD 70,000 - 117,000
Medical/Dental/Vision/Life Insurance
Paid holidays and PTO
401(k) plan and contributions
+3
Data Quality Engineer (Databricks & dbt)
Data Quality Engineer (Databricks & dbt)

Cognizant • Frankfort (KY)

Remote
USD 70,000 - 117,000
Data Quality Engineer (Databricks & dbt)
Data Quality Engineer (Databricks & dbt)

Cognizant • Jackson (MS)

Remote
USD 70,000 - 117,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
Data Quality & Databricks Specialist (Governance)
Data Quality & Databricks Specialist (Governance)

Insight Global (United States) • Juno Beach (FL)

On-site
USD 90,000 - 130,000
Senior AI & Quality Analytics Engineer
Senior AI & Quality Analytics Engineer

7101 C.R. Bard, Inc. • San Diego (CA)

On-site
USD 161,000 - 258,000