Databricks QA Engineer — Data Pipelines & CI (Contract)

V4C.ai; United States; Remote; USD 96,000 - 110,000; Part time

Job summary

V4C is seeking a QA Engineer focused on data engineering to own the quality gate for enterprise data platforms. You will validate Lakehouse pipelines, implement data quality as code, and maintain automated tests in Python and PySpark within CI pipelines.

You will work with a highly certified Databricks delivery team, review end-to-end pipelines, and drive release sign-off to prevent bad data from reaching customers.

Qualifications

• 5+ years in QA automation or test engineering, including data pipelines.
• A data engineering background: you can read a pipeline and verify transformations with SQL.
• Expert-level SQL and hands-on Databricks experience are required.
• Experience with Medallion architecture, Delta Lake, and ELT-based data platforms.
• Experience building automated suites that run in CI and gate deployment.
• Hands-on experience with Databricks or similar platforms.

Responsibilities

• Own test strategy and release sign-off on engagements with documented test plans.
• Build and maintain automated test suites in Python and PySpark (pytest) in CI.
• Validate end-to-end data pipelines: ingestion, Medallion layers, Delta Lake, ELT workflows.
• Implement data quality rules as code and reusable validation frameworks.
• Run regression validation after code changes and maintain CI quality gates.
• Collaborate with engineers to raise coverage and quality across the practice.

Skills

QA automation

SQL

Python

PySpark

CI/CD

Databricks

Tools

Delta Lake

Lakeflow

Unity Catalog

Azure DevOps

GitHub Actions

Job description

V4C is seeking a QA Engineer focused on data engineering to own the quality gate for enterprise data platforms. You will validate Lakehouse pipelines, implement data quality as code, and maintain automated tests in Python and PySpark within CI pipelines.

You will work with a highly certified Databricks delivery team, review end-to-end pipelines, and drive release sign-off to prevent bad data from reaching customers.