A technology services company is seeking a Data Quality Lead with over 12 years of experience in data QA/testing and strong expertise in Azure Data Lake, Databricks, and ADF pipelines. The role requires writing and implementing DQ rules, along with a deep understanding of data governance and compliance. Candidates should have technical proficiency in Python, PySpark, and SQL, and the ability to manage hybrid teams. This is a remote contract position.
Qualifications
12+ years in data QA/testing with lead-level experience required.
Strong expertise with Azure Data Lake, Databricks, ADF pipelines, and Collibra DQ.
Proficiency in writing and implementing DQ rules.
Skills
Data QA/testing
Azure Data Lake
Databricks
ADF pipelines
Collibra DQ
Python
PySpark
SQL
Data governance
Interpersonal skills
Job description
Senior Executive | US IT Recruiter @ VBeyond | Executive
Role: Data Quality Lead
Mode: Contract
Location: Remote
Required Skills & Experience
12+ years in data QA/testing, with lead‑level experience (not high‑level strategy only).
Strong expertise in Azure Data Lake, Databricks, ADF pipelines, and Collibra DQ.
Ability to write and implement DQ rules, both adaptive and custom.
Technical proficiency in Python, PySpark, SQL for automation.
Deep understanding of data governance, metadata management, and compliance (HIPAA, CMS).
Experience guiding developers and managing hybrid teams.
Strong interpersonal skills and ability to work in a fast‑paced environment with multiple priorities.
Preferred Qualifications
Familiarity with healthcare payer data standards, HEDIS, CMS Interoperability (FHIR).
Knowledge of Lakehouse architecture, medallion design patterns, and BI validation (Power BI, Tableau).