Databricks QA Engineer

Ali Aydi

United States

Remote

USD 96,000 - 110,000

Part time

6 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ali Aydi is seeking a QA Engineer specialized in data pipelines to own the quality gate for enterprise data platforms. The role focuses on validating Lakehouse pipelines, writing automated tests in Python and PySpark, and ensuring data quality before production releases.

Candidates should have 5+ years in data-pipeline QA, strong SQL, and hands-on Databricks experience. This is a contract engagement with a pay rate of $70–$80 per hour, open to contractors across the United States.

Qualifications

  • 5+ years in QA automation or test engineering focused on data pipelines.

Responsibilities

  • Own test strategy and release sign-off with documented test plans.
  • Build and maintain automated test suites in Python and PySpark (pytest) integrated into CI.
  • Validate end-to-end data pipelines: ingestion, Medallion layer transformations, Delta Lake tables, ELT workflows.
  • Implement data quality rules as code, including Lakeflow expectations.
  • Run regression validation after code changes and maintain CI quality gates.

Skills

QA automation
Python
SQL
PySpark
CI pipelines
Databricks
Delta Lake
ELT

Tools

GitHub Actions
Azure DevOps
GitLab CI

Job description

V4C is a pure-play Databricks partner, and in under two years we have earned 850+ Databricks certifications across 325+ customers and been named Databricks' 2026 Partner of the Year (C&SI Emerging).

As a Databricks QA Engineer on our data engineering team you will own the quality gate for enterprise data platforms, working directly with customers. You will work on live enterprise data platforms alongside one of the most heavily Databricks-certified delivery teams in the market.

The Role

This is a QA role for people who understand data engineering, not general software QA pointed at a data project. You will validate Lakehouse pipelines, which means reasoning about row counts, schema drift, late-arriving data, and silent transformation errors no UI will ever surface. Our approach is automation-first: suites in Python and PySpark, running in CI, blocking promotion when they fail. You own release sign-off, which makes you the last person between a customer and bad data in production.

Responsibilities

  • Own test strategy and release sign-off on engagements, including documented test plans covering scope, risk, and coverage
  • Build and maintain automated test suites in Python and PySpark (pytest), integrated into CI pipelines
  • Validate data pipelines end to end: ingestion, Medallion layer transformations, Delta Lake tables, and ELT workflows
  • Implement data quality rules as code, including Lakeflow expectations and reusable validation frameworks
  • Run regression validation after code changes and maintain CI quality gates that block merge or promotion on failure
  • Partner with engineers to identify automation candidates and raise the coverage bar across the practice
  • 5+ years in QA automation or test engineering, including meaningful time testing data pipelines rather than applications alone
  • A data engineering background: you can read a pipeline, reason about a transformation, and write the SQL to verify it
  • Expert-level SQL
  • Experience with Medallion architecture, Delta Lake, and ELT-based data platforms
  • Experience building automated suites that run in CI and gate deployment
  • Demonstrable hands-on experience working on Databricks or similar platforms

Preferences

  • Healthcare or life sciences experience preferred but not required
  • Existing Databricks certification(s)
  • Hands-on experience with Unity Catalog, Lakeflow pipelines, or Databricks Asset Bundles
  • Experience with Azure DevOps pipelines, or equivalent CI tooling (GitHub Actions, GitLab CI)
  • Familiarity with contract-based data validation standards such as ODCS
  • Experience using LLM agents or MCP-connected tooling to run validations, triage failures, or draft defect reports
  • Consulting or client-facing background

Pay Rate: $70 – $80 per hour (1099 independent contractor).

This is a contract engagement rather than a salaried employee role. Where a rate lands within the range depends on depth of data-pipeline testing experience and automation capability. Open to contractors anywhere in the United States.

Tags

Full-Stack Programming Python SQL and Data Engineering

Details

Who may apply USA Only As the board states it — check the description for country or time-zone limits.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

V4C.ai: Databricks QA Engineer
V4C.ai: Databricks QA Engineer

Hire Developers • United States

Remote
USD 96,000 - 110,000
Databricks QA Engineer
Databricks QA Engineer

V4C.ai • United States

Remote
USD 96,000 - 110,000
Contract engagement (1099)
Remote work within United States
Databricks QA Engineer — Automate Enterprise Data Pipelines
Databricks QA Engineer — Automate Enterprise Data Pipelines

V4C.ai • United States

Remote
USD 96,000 - 110,000
Contract engagement (1099)
Remote work within United States
Databricks QA Engineer: Data Pipelines & Automation (Contract)
Databricks QA Engineer: Data Pipelines & Automation (Contract)

Hire Developers • United States

Remote
USD 96,000 - 110,000
Senior Databricks QA Engineer Role - $70-$80/hr
Senior Databricks QA Engineer Role - $70-$80/hr

V4C.ai • United States

Remote
USD 96,000 - 110,000
Remote work within US
Remote Senior Databricks QA Engineer—Data Quality
Remote Senior Databricks QA Engineer—Data Quality

V4C.ai • United States

Remote
USD 96,000 - 110,000
Remote work within US
Sr. Business Analyst / Solutions Architect (Remote, US)
Sr. Business Analyst / Solutions Architect (Remote, US)

V4C.ai • United States

Remote
USD 103,000 - 138,000
Sr. Business Analyst / Solutions Architect (Remote, US)
Sr. Business Analyst / Solutions Architect (Remote, US)

V4C.ai • Washington

Remote
USD 103,000 - 138,000
Databricks Engineer (Remote, US)
Databricks Engineer (Remote, US)

V4C.ai • United States

Remote
USD 140,000 - 210,000
Unlimited PTO
Health Care Plan
Retirement Plan (401k)
+5
ETL QA -Databricks
ETL QA -Databricks

VeeRteq Solutions LLC • Irving (TX)

On-site
USD 120,000 - 150,000