Data Quality Engineer

i4DM

United States

Remote

USD 100,000 - 150,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Healthcare coverage
HSA Plan
Life and Disability Insurance
Retirement Savings Plan

Job summary

i4DM seeks an experienced Data Quality Engineer to support ATLAS, the VA’s multi-cloud data management and analytics platform. You will design and automate validation, testing, profiling, and monitoring frameworks to ensure accuracy and reliability of multi-source data as it is ingested and delivered to data products.

You will work with Azure Synapse, Databricks, Collibra Data Quality, Profisee, SQL, and Python to detect anomalies, enforce governance, and improve data trust for Veterans and

Qualifications

  • 3+ years of experience in a cloud-based environment.
  • Experience in analyzing and profiling data.
  • Proficiency in SQL and Python for data work.
  • Experience building automated testing frameworks for data quality assurance.
  • Hands-on experience with Azure data tools (Synapse, Databricks).
  • Knowledge of cloud testing practices and patterns.
  • Ability to develop test plans with JIRA X-RAY and automate tests with Collibra/Profisee.

Responsibilities

  • Design and implement data validation and quality assurance processes for cloud environments.
  • Automate data quality checks and develop monitoring solutions to detect anomalies.
  • Collaborate with data engineers and analysts on governance and compliance.
  • Profile structured and unstructured datasets for accuracy and consistency.
  • Build and maintain automated testing frameworks to catch data issues.
  • Utilize Azure Synapse and Databricks for data engineering tasks.
  • Create and execute comprehensive test plans using JIRA X-RAY and related tools.

Skills

Data profiling
SQL
Python
Test automation
Cloud environments

Education

Bachelor’s degree or 4+ years of relevant experience in lieu of a degree

Tools

Azure Synapse
Databricks
Collibra Data Quality
Profisee
JIRA
JIRA X-RAY
Python
Scala

Job description

Description About the Role

We are seeking an experienced Data Quality Engineer to support ATLAS, the VA’s open-architected, multi-cloud enterprise data management and analytics platform. In this role, you will design and automate validation, testing, profiling, and monitoring frameworks that ensure the accuracy, consistency, completeness, and reliability of multi-source data as it is ingested, conditioned, curated, and delivered as consumable enterprise data products. Working with Azure Synapse, Databricks, Collibra Data Quality, Profisee, SQL, Python, and related tools, you will detect anomalies, enforce governance standards, and improve trust in data across interoperating ATLAS platforms. You will collaborate with data engineers, analysts, data scientists, and product teams to provide consistent, secure access to high-quality data that enables evidence-based decisions and improves outcomes for Veterans and their families.

Key Responsibilities

Design and implement data validation and quality assurance processes for cloud-based environments. Automate data quality checks and develop monitoring solutions to detect data anomalies. Collaborate with data engineers and analysts to ensure data governance and compliance. Analyze and profile structured and unstructured datasets for accuracy and consistency. Build and maintain automated testing frameworks to proactively catch data issues. Utilize Azure data engineering and ELT tools, including Azure Synapse and Databricks. Create and execute comprehensive test plans using tools such as JIRA’s X-RAY. Implement and execute test automation using CoTS tooling like Collibra's Data Quality, Microsoft’s Profisee, or custom scripts in Python or Scala. TAG: #LI-I4DM TAG: INDMJC

Requirements Minimum Qualifications
  • 3+ years of experience working in a cloud-based environment.
  • Experience in analyzing and profiling data.
  • Proficiency in querying and working with data using SQL and Python.
  • Experience in building automated testing frameworks for data quality assurance.
  • Hands-on experience with Azure tools for data engineering and ELT, including Azure Synapse and Databricks.
  • Strong knowledge of best testing practices and patterns in cloud environments.
  • Ability to work independently within a mid-sized team and rapidly develop test plans using JIRA’s X-RAY.
  • Proficiency in implementing automated test plans using Collibra's Data Quality, Microsoft Profisee, or script-based testing with Python or Scala.
  • Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements.
  • Bachelor’s degree or 4+ years of relevant experience in lieu of a degree.
  • Experience with Synapse Pipelines, Azure Data Factory, Starburst, Azure Data Lake Service, Azure ML/AI services, and Pyramid Analytics/Power BI for visualization.
Preferred Qualifications
  • Familiarity with JIRA and Confluence for project tracking and documentation.
  • Ability to integrate testing protocols with monitoring applications such as Dynatrace, Splunk, or Log Analytics.
  • Bachelor’s degree in Computer Science or a related field.
  • Azure Data Engineer Certification.
Benefits

Comprehensive healthcare coverage, HSA Plan, Life and Disability Insurance, and Retirement Savings Plan.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Quality Engineer
Data Quality Engineer

i4DM • Millersville (MD)

On-site
USD 90,000 - 140,000
Healthcare coverage
HSA Plan
Life and Disability Insurance
+1
SQL Developer / Database Engineer
SQL Developer / Database Engineer

i4DM • United States

Remote
USD 120,000 - 180,000
Azure Data Integration Engineer
Azure Data Integration Engineer

i4DM • United States

Remote
USD 140,000 - 190,000
Health insurance
HSA Plan
Life insurance
+2
Azure Data Integration Engineer
Azure Data Integration Engineer

i4DM • Millersville (MD)

On-site
USD 120,000 - 160,000
Healthcare coverage
HSA Plan
Life and Disability Insurance
+1
SQL Developer / Database Engineer
SQL Developer / Database Engineer

i4DM • Millersville (MD)

On-site
USD 120,000 - 160,000
Data Quality Engineer: Cloud Validation & Automation
Data Quality Engineer: Cloud Validation & Automation

i4DM • United States

Remote
USD 100,000 - 150,000
Healthcare coverage
HSA Plan
Life and Disability Insurance
+1
DevSecOps / Cloud Platform Engineer
DevSecOps / Cloud Platform Engineer

i4DM • United States

Remote
USD 140,000 - 180,000
Comprehensive healthcare coverage
HSA Plan
Life and Disability Insurance
+1
DevSecOps / Cloud Platform Engineer
DevSecOps / Cloud Platform Engineer

i4DM • Millersville (MD)

On-site
USD 140,000 - 180,000
Comprehensive healthcare coverage
HSA Plan
Life and Disability Insurance
+1
Cloud Data Quality Engineer: Validation & Governance
Cloud Data Quality Engineer: Validation & Governance

i4DM • Millersville (MD)

On-site
USD 90,000 - 140,000
Healthcare coverage
HSA Plan
Life and Disability Insurance
+1
Senior Data Engineer
Senior Data Engineer

Node.Digital LLC • Washington

Remote
USD 140,000 - 190,000
Medical
Dental
Vision
+6