QA Automation Engineer with Databricks

Vizient; Chicago (IL); On-site; USD 89,000 - 156,000; Full time

Benefits offered by this job

Incentive eligible

Comprehensive benefits

Job summary

Vizient seeks a data testing professional to develop and maintain automated test suites for Databricks jobs, Delta tables, views, data transformations, and ETL pipelines. The role validates metrics, reconciliations, and data quality across systems, and creates test data and SQL queries for robust coverage.

You will implement automated tests for full/incremental loads, handle retries and errors, and integrate tests into CI/CD pipelines.

Responsibilities

• Develop and maintain automated test suites for Databricks jobs, Delta tables, views, data transformations, and ETL pipelines.
• Validate metric calculations, business rules, aggregations, derived values, and source-to-target data transformations within Databricks.
• Perform source-to-target reconciliation and validate data completeness, accuracy, consistency, timeliness, and referential integrity across systems.
• Develop automated tests for full and incremental loads, updates, deletes, retries, exception handling, and recovery scenarios.
• Create test data, SQL validation queries, reusable utilities, and reconciliation frameworks to improve testing efficiency and coverage.
• Integrate automated data tests into CI/CD pipelines and enhance test automation frameworks and processes.
• Perform functional, integration, regression, and end-to-end testing across large-scale data solutions.
• Analyze test failures, conduct root cause analysis, document defects, and collaborate with data engineering and platform teams to resolve issues.

Tools

Databricks

Delta tables

Stardog

SPARQL

Job description

Excited to grow your career? We value our talented employees and instill an environment where you feel engaged, satisfied and able to contribute your unique skills and talents while living and working as your authentic self. We provide extensive opportunities for personal and professional development, building employee competence and organizational capability to fuel exceptional performance through an inclusive environment both now and in the future. Our people make all the difference in our success.

Required Responsibilities

• Develop and maintain automated test suites for Databricks jobs, Delta tables, views, data transformations, and ETL pipelines.
• Validate metric calculations, business rules, aggregations, derived values, and source-to-target data transformations within Databricks.
• Perform source-to-target reconciliation and validate data completeness, accuracy, consistency, timeliness, and referential integrity across systems.
• Develop automated tests for full and incremental loads, updates, deletes, retries, exception handling, and recovery scenarios.
• Create test data, SQL validation queries, reusable utilities, and reconciliation frameworks to improve testing efficiency and coverage.
• Integrate automated data tests into CI/CD pipelines and enhance test automation frameworks and processes.
• Perform functional, integration, regression, and end-to-end testing across large-scale data solutions.
• Analyze test failures, conduct root cause analysis, document defects, and collaborate with data engineering and platform teams to resolve issues.

Preferred Responsibilities

• Validate data and integrations involving Stardog, knowledge graph platforms, and other data technologies.
• Test knowledge graph structures, ontologies, relationships, mappings, SPARQL queries, data lineage, and provenance.

Career Framework:

Professional - Senior Associate (P3)

Estimated Hiring Range:

At Vizient, we consider skills, experience, and organizational needs in our compensation approach. Geographic factors may adjust the range estimate and hires typically fall below the top range. Compensation decisions are tailored to individual circumstances. The current salary range for this role is $88,900.00 to $155,500.00.

This position is also incentive eligible.

Vizient has a comprehensive benefits plan! Please view our benefits here: http://www.vizientinc.com/about-us/careers