Senior Data Quality Engineer: ETL & Automation

GSPANN Technologies, Inc.

California

On-site

CAD 90,000 - 140,000

Full time

31 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

GSPANN Technologies, Inc. is seeking a Senior Data Quality Engineer to join our data integrity and pipeline testing team. You will design and execute data quality strategies, validate large datasets, and automate tests across Databricks, ADF, SQL, Python and Scala.

The role covers API and Kafka testing, as well as automation using Playwright with TypeScript and Appium for mobile apps. Collaboration with data engineers and product teams is essential for success.

Qualifications

  • Hands-on experience with Databricks, Azure Data Factory (ADF), SQL, Python and Scala.
  • Experience with API, Kafka and application automation testing.

Responsibilities

  • We are looking for an experienced Data Quality Engineer with strong expertise in data validation, ETL testing, data pipeline testing and test automation.
  • Design, develop and execute data quality and ETL testing strategies, test plans and test cases.
  • Perform data validation, reconciliation, integrity checks and data profiling across source and target systems.
  • Validate data pipelines, transformations and workflows using Databricks and Azure Data Factory (ADF).
  • Develop complex SQL queries to validate large datasets and identify data discrepancies.
  • Use Python and Scala for data validation, test automation and data processing.
  • Perform API testing and validate data exchanges between integrated systems.
  • Conduct Kafka testing to validate event-driven data flows, message integrity and data consistency.
  • Develop and maintain automated testing frameworks using Playwright with TypeScript and Appium for iOS/Android applications.
  • Validate data integration and campaign workflows across Adobe Campaign, Braze and Epsilon platforms.
  • Leverage GenAI and MCP-driven automation approaches, including tools such as Claude, to improve testing efficiency.
  • Identify, troubleshoot and report data quality issues, defects and inconsistencies.
  • Collaborate with data engineers, developers, product teams and business stakeholders to resolve issues.
  • Manage test execution, defect tracking and test documentation using Jira and TestRail.
  • Maintain automation scripts, test assets and code repositories using GitHub.

Skills

Data validation
ETL testing
Test automation
SQL
Python
Scala
API testing
Kafka testing
Playwright TS
Appium (iOS/Android)

Tools

Databricks
Azure Data Factory
Playwright
Appium
Jira
TestRail
GitHub
Adobe Campaign
Braze
Epsilon
Claude

Job description

GSPANN Technologies, Inc. is seeking a Senior Data Quality Engineer to join our data integrity and pipeline testing team. You will design and execute data quality strategies, validate large datasets, and automate tests across Databricks, ADF, SQL, Python and Scala.

The role covers API and Kafka testing, as well as automation using Playwright with TypeScript and Appium for mobile apps. Collaboration with data engineers and product teams is essential for success.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr Data Quality Engineer
Sr Data Quality Engineer

GSPANN Technologies, Inc. • California

On-site
CAD 90,000 - 140,000
Data Quality Engineer
Data Quality Engineer

Select Minds LLC • Dallas (TX)

Hybrid
USD 120,000 - 150,000
W2 Opportunity
Competitive salary
Opportunity for advancement
Senior Data Quality Engineer - AI Analytics Platform
Senior Data Quality Engineer - AI Analytics Platform

BD • Sparks Corner (MD)

On-site
USD 161,000 - 258,000
Health & Well-being
Retirement & Financial Well-being
Work-Life Balance & Family Support
+1
Senior Data Engineer: Scalable Pipelines & Data Quality
Senior Data Engineer: Scalable Pipelines & Data Quality

TechDigital Group • Burbank (CA)

On-site
USD 120,000 - 150,000
Senior Data QA Engineer — ETL/Databricks Validation Lead
Senior Data QA Engineer — ETL/Databricks Validation Lead

Axos Business Center • United States

Remote
USD 115,000 - 125,000
Medical, Dental, Vision & Life
Paid Sick Leave
3 weeks vacation & Holidays
+2
Senior Data Engineer
Senior Data Engineer

Veriipro • Atlanta (GA)

On-site
USD 140,000 - 180,000
Senior ETL Tester — Python/PySpark, Cloud & Data Quality
Senior ETL Tester — Python/PySpark, Cloud & Data Quality

MACHINE LEARNING TECHNOLOGIES LLC • Boston (MA)

On-site
USD 90,000 - 120,000
Data Quality Engineer - Spark, Kafka & AWS (Hybrid Dallas)
Data Quality Engineer - Spark, Kafka & AWS (Hybrid Dallas)

Select Minds LLC • Dallas (TX)

Hybrid
USD 120,000 - 150,000
W2 Opportunity
Competitive salary
Opportunity for advancement
Data Quality Engineer: ETL Validation & Automation
Data Quality Engineer: ETL Validation & Automation

Compunnel Inc. • New Jersey

On-site
USD 85,000 - 110,000
Senior Quality Engineer
Senior Quality Engineer

MindPlus (Pvt) Ltd • United States

Remote
USD 90,000 - 130,000