Databricks QA Automation Engineer: Data Testing & CI/CD

Vizient, Inc; Chicago (IL); On-site; USD 100,000 - 156,000; Full time

Benefits offered by this job

Comprehensive benefits plan

Incentive eligibility

Job summary

Vizient, Inc is seeking a data test engineer to develop and maintain automated test suites for Databricks jobs, Delta tables, views, and ETL pipelines. You will validate metrics, business rules, and data transformations while ensuring data completeness and referential integrity across systems.

You will design automated tests for full and incremental loads, create validation queries, and integrate tests into CI/CD pipelines, working with data engineering and platform teams to resolve issues in a

Qualifications

• Experience developing automated data tests for large-scale data solutions.
• Strong SQL skills for validation queries.
• Experience integrating tests into CI/CD pipelines.

Responsibilities

• Develop and maintain automated test suites for Databricks jobs, Delta tables, views, data transformations, and ETL pipelines.
• Validate metric calculations, business rules, aggregations, derived values, and source-to-target data transformations within Databricks.
• Perform source-to-target reconciliation and validate data completeness, accuracy, consistency, timeliness, and referential integrity across systems.
• Develop automated tests for full and incremental loads, updates, deletes, retries, exception handling, and recovery scenarios.
• Create test data, SQL validation queries, reusable utilities, and reconciliation frameworks to improve testing efficiency and coverage.
• Integrate automated data tests into CI/CD pipelines and enhance test automation frameworks and processes.
• Perform functional, integration, regression, and end-to-end testing across large-scale data solutions.
• Analyze test failures, conduct root cause analysis, document defects, and collaborate with data engineering and platform teams to resolve issues.

Skills

Databricks

SQL

CI/CD

Test automation

Tools

Stardog

Knowledge graph platforms

Job description

Vizient, Inc is seeking a data test engineer to develop and maintain automated test suites for Databricks jobs, Delta tables, views, and ETL pipelines. You will validate metrics, business rules, and data transformations while ensuring data completeness and referential integrity across systems.

You will design automated tests for full and incremental loads, create validation queries, and integrate tests into CI/CD pipelines, working with data engineering and platform teams to resolve issues in a