ETL Automation Lead - Big Data Testing & Validation

Quantum Technologies. LLC

Tampa (FL)

On-site

USD 98,000 - 134,000

Full time

10 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies LLC in Tampa, FL seeks an experienced ETL Automation Test Engineer to design and implement automated tests for Ab Initio ETL workflows and large data sets.

You will develop Python and PySpark scripts, write complex SQL, and perform end-to-end, regression, and data-quality validation, collaborating with engineers, analysts, and QA. This contract role runs for 10 months with extension potential; compensation is $84/hour and on-site work.

Qualifications

  • Experience automating ETL tests for large-scale data pipelines.
  • Proficient in Ab Initio ETL testing and data quality validation.
  • Strong Python and PySpark scripting for test automation.
  • Advanced SQL/Oracle skills with complex data reconciliation.
  • Unix shell scripting and Big Data validation experience.

Responsibilities

  • Design and maintain automated tests for Ab Initio ETL apps.
  • Build reusable Python/PySpark automation scripts.
  • Perform source-to-target validation and data quality checks.
  • Validate data across Ab Initio, Hive, Oracle, and Big Data.
  • Develop complex SQL queries for backend validation.
  • Create Unix shell scripts to support test automation.
  • Lead end-to-end, regression, and integration testing.
  • Mentor team members and set testing standards (Lead).

Skills

Ab Initio ETL
Python
PySpark
SQL
Unix Shell
Hive
Data quality
Data reconciliation

Tools

Ab Initio Control Center
Selenium
Java

Job description

Quantum Technologies LLC in Tampa, FL seeks an experienced ETL Automation Test Engineer to design and implement automated tests for Ab Initio ETL workflows and large data sets.

You will develop Python and PySpark scripts, write complex SQL, and perform end-to-end, regression, and data-quality validation, collaborating with engineers, analysts, and QA. This contract role runs for 10 months with extension potential; compensation is $84/hour and on-site work.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Automation Lead • Ab Initio & PySpark QA
ETL Automation Lead • Ab Initio & PySpark QA

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead — Ab Initio & PySpark Expert
ETL Automation Lead — Ab Initio & PySpark Expert

CloudBigD • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead — Ab Initio & Big Data QA
ETL Automation Lead — Ab Initio & Big Data QA

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
Senior ETL Automation Lead — Ab Initio & Big Data
Senior ETL Automation Lead — Ab Initio & Big Data

Valiant Technologies LLC • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Valiant Technologies LLC • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

CloudBigD • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Quantum Technologies. LLC • Tampa (FL)

On-site
USD 98,000 - 134,000
Senior ETL Tester — Data Automation & Cloud Testing Expert
Senior ETL Tester — Data Automation & Cloud Testing Expert

Quantum Technologies LLC • Boston (MA)

On-site
USD 86,000 - 123,000