Sr Data Quality Engineer

GSPANN Technologies, Inc.

California

On-site

CAD 90,000 - 140,000

Full time

31 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

GSPANN Technologies, Inc. is seeking a Senior Data Quality Engineer to join our data integrity and pipeline testing team. You will design and execute data quality strategies, validate large datasets, and automate tests across Databricks, ADF, SQL, Python and Scala.

The role covers API and Kafka testing, as well as automation using Playwright with TypeScript and Appium for mobile apps. Collaboration with data engineers and product teams is essential for success.

Qualifications

  • Hands-on experience with Databricks, Azure Data Factory (ADF), SQL, Python and Scala.
  • Experience with API, Kafka and application automation testing.

Responsibilities

  • We are looking for an experienced Data Quality Engineer with strong expertise in data validation, ETL testing, data pipeline testing and test automation.
  • Design, develop and execute data quality and ETL testing strategies, test plans and test cases.
  • Perform data validation, reconciliation, integrity checks and data profiling across source and target systems.
  • Validate data pipelines, transformations and workflows using Databricks and Azure Data Factory (ADF).
  • Develop complex SQL queries to validate large datasets and identify data discrepancies.
  • Use Python and Scala for data validation, test automation and data processing.
  • Perform API testing and validate data exchanges between integrated systems.
  • Conduct Kafka testing to validate event-driven data flows, message integrity and data consistency.
  • Develop and maintain automated testing frameworks using Playwright with TypeScript and Appium for iOS/Android applications.
  • Validate data integration and campaign workflows across Adobe Campaign, Braze and Epsilon platforms.
  • Leverage GenAI and MCP-driven automation approaches, including tools such as Claude, to improve testing efficiency.
  • Identify, troubleshoot and report data quality issues, defects and inconsistencies.
  • Collaborate with data engineers, developers, product teams and business stakeholders to resolve issues.
  • Manage test execution, defect tracking and test documentation using Jira and TestRail.
  • Maintain automation scripts, test assets and code repositories using GitHub.

Skills

Data validation
ETL testing
Test automation
SQL
Python
Scala
API testing
Kafka testing
Playwright TS
Appium (iOS/Android)

Tools

Databricks
Azure Data Factory
Playwright
Appium
Jira
TestRail
GitHub
Adobe Campaign
Braze
Epsilon
Claude

Job description

Headquartered in California, U.S.A., GSPANN is a leading provider of consulting and IT services to global clients. We specialize in helping clients transform their IT capabilities, optimize business practices, and drive operational efficiency across industries such as retail, high-technology, and manufacturing. With five global delivery centers and over 2500 employees, we combine the personalized approach of a boutique consultancy with the extensive capabilities of a large IT services firm.

Senior Data Quality Engineer
Duration: 12+ Months
Core Skills & Competencies:

Databricks, Azure Data Factory (ADF), ETL & Data Quality Testing, SQL, Scala, Playwright (TypeScript), Appium (iOS/Android), Python, API & Kafka Testing, Adobe Campaign, Braze, Epsilon, GenAI/MCP-driven Automation, Claude, Jira, TestRail and GitHub.

Key Responsibilities
  • We are looking for an experienced Data Quality Engineer with strong expertise in data validation, ETL testing, data pipeline testing and test automation. The ideal candidate should have hands-on experience working with Databricks, Azure Data Factory (ADF), SQL, Python and Scala, along with exposure to API, Kafka and application automation testing.
  • Design, develop and execute data quality and ETL testing strategies, test plans and test cases.
  • Perform data validation, reconciliation, integrity checks and data profiling across source and target systems.
  • Validate data pipelines, transformations and workflows using Databricks and Azure Data Factory (ADF).
  • Develop complex SQL queries to validate large datasets and identify data discrepancies.
  • Use Python and Scala for data validation, test automation and data processing.
  • Perform API testing and validate data exchanges between integrated systems.
  • Conduct Kafka testing to validate event-driven data flows, message integrity and data consistency.
  • Develop and maintain automated testing frameworks using Playwright with TypeScript and Appium for iOS/Android applications.
  • Validate data integration and campaign workflows across Adobe Campaign, Braze and Epsilon platforms.
  • Leverage GenAI and MCP-driven automation approaches, including tools such as Claude, to improve testing efficiency.
  • Identify, troubleshoot and report data quality issues, defects and inconsistencies.
  • Collaborate with data engineers, developers, product teams and business stakeholders to resolve issues.
  • Manage test execution, defect tracking and test documentation using Jira and TestRail.
  • Maintain automation scripts, test assets and code repositories using GitHub.
Working at GSPANN

GSPANN is a diverse, prosperous, and rewarding place to work. We provide competitive benefits, educational assistance, and career growth opportunities to our employees. Every employee is valued for their talent and contribution. Working with us will give you an opportunity to work globally with some of the best brands in the industry.

The company does and will take affirmative action to employ and advance in the employment of individuals with disabilities and protected veterans and to treat qualified individuals without discrimination based on their physical or mental disability status. GSPANN is an equal opportunity employer for minorities/females/veterans/disabled.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Quality Engineer: ETL & Automation
Senior Data Quality Engineer: ETL & Automation

GSPANN Technologies, Inc. • California

On-site
CAD 90,000 - 140,000
Azure Data Engineer (Onsite / Hybrid)
Azure Data Engineer (Onsite / Hybrid)

GSPANN Technologies, Inc. • Fremont (CA)

Hybrid
USD 150,000 - 190,000
Azure Data Engineer (Hybrid/Onsite/F2F)
Azure Data Engineer (Hybrid/Onsite/F2F)

GSPANN Technologies, Inc. • Fremont (CA)

Hybrid
USD 140,000 - 190,000
Competitive benefits
Educational assistance
Career growth opportunities
Lead Quality Automation Engineer
Lead Quality Automation Engineer

GSPANN Technologies, Inc. • San Francisco (CA)

On-site
USD 140,000 - 190,000
Quality Automation Engineer
Quality Automation Engineer

GSPANN Technologies, Inc. • New York (NY)

Hybrid
USD 120,000 - 180,000
Palantir Foundry Architect
Palantir Foundry Architect

GSPANN Technologies, Inc. • Livermore (CA)

On-site
USD 110,000 - 150,000
Lead QE Automation
Lead QE Automation

GSPANN Technologies, Inc. • San Ramon (CA)

On-site
USD 120,000 - 180,000
Competitive benefits
Educational assistance
Career growth opportunities
Data Quality Engineer
Data Quality Engineer

Select Minds LLC • Dallas (TX)

Hybrid
USD 120,000 - 150,000
W2 Opportunity
Competitive salary
Opportunity for advancement
Senior Data Engineer – Databricks & AWS
Senior Data Engineer – Databricks & AWS

Quantum Technologies LLC • Sunnyvale (CA)

On-site
USD 76,000 - 108,000
Senior Data Engineer – Databricks & AWS
Senior Data Engineer – Databricks & AWS

Ethereum Technologies LLC • Sunnyvale (CA)

On-site
USD 76,000 - 108,000