ETL Automation Lead / Engineer

Quantum Technologies. LLC

Tampa (FL)

On-site

USD 98,000 - 134,000

Full time

10 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies LLC in Tampa, FL seeks an experienced ETL Automation Test Engineer to design and implement automated tests for Ab Initio ETL workflows and large data sets.

You will develop Python and PySpark scripts, write complex SQL, and perform end-to-end, regression, and data-quality validation, collaborating with engineers, analysts, and QA. This contract role runs for 10 months with extension potential; compensation is $84/hour and on-site work.

Qualifications

  • Experience automating ETL tests for large-scale data pipelines.
  • Proficient in Ab Initio ETL testing and data quality validation.
  • Strong Python and PySpark scripting for test automation.
  • Advanced SQL/Oracle skills with complex data reconciliation.
  • Unix shell scripting and Big Data validation experience.

Responsibilities

  • Design and maintain automated tests for Ab Initio ETL apps.
  • Build reusable Python/PySpark automation scripts.
  • Perform source-to-target validation and data quality checks.
  • Validate data across Ab Initio, Hive, Oracle, and Big Data.
  • Develop complex SQL queries for backend validation.
  • Create Unix shell scripts to support test automation.
  • Lead end-to-end, regression, and integration testing.
  • Mentor team members and set testing standards (Lead).

Skills

Ab Initio ETL
Python
PySpark
SQL
Unix Shell
Hive
Data quality
Data reconciliation

Tools

Ab Initio Control Center
Selenium
Java

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: ETL Automation Lead / Engineer
Location: Tampa, FL
Duration: 10 Months + Extension
Bill Rate: $84/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description

We are seeking an experienced ETL Automation Test Engineer with strong expertise in Ab Initio ETL testing, Python, PySpark, SQL, and Big Data validation. The candidate will be responsible for developing automated testing solutions, validating large-volume datasets, performing data reconciliation, and ensuring the accuracy and quality of ETL workflows.

Key Responsibilities:
  • Design, develop, and maintain automated test solutions for Ab Initio ETL applications.
  • Build reusable automation scripts and frameworks using Python and PySpark.
  • Perform source-to-target, data transformation, reconciliation, and data-quality validation.
  • Validate large datasets across Ab Initio, Hive, Oracle, and Big Data environments.
  • Develop complex SQL queries for backend and ETL data validation.
  • Create Unix Shell scripts to support test automation and batch validation.
  • Perform end-to-end, functional, regression, and integration testing.
  • Analyze Ab Initio job failures, investigate data discrepancies, and perform root-cause analysis.
  • Improve automation coverage and reduce manual testing efforts.
  • Collaborate with developers, data engineers, business analysts, and QA teams.
  • For Lead-level candidates, provide technical guidance, review automation scripts, establish testing standards, and mentor team members.
Mandatory Technical Skills:
  • Strong hands-on experience in Ab Initio ETL Automation Testing.
  • Python scripting for ETL test automation.
  • PySpark scripting for large-volume data validation.
  • Strong SQL and Oracle knowledge, including complex queries and data reconciliation.
  • Unix and Unix Shell Scripting.
  • Hive and Big Data validation.
  • Source-to-target data validation and transformation testing.
  • ETL regression testing, data reconciliation, and data-quality validation.
Preferred Skills:
  • Java and Selenium Automation.
  • Working knowledge of Ab Initio Control Center.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

CloudBigD • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Valiant Technologies LLC • Tampa (FL)

On-site
USD 95,000 - 136,000
Senior ETL Tester
Senior ETL Tester

Quantum Technologies LLC • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Robotics Technologies • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

CloudBigD • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Valiant Technologies LLC • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Ethereum Technologies LLC • Boston (MA)

On-site
USD 90,000 - 120,000
Senior ETL Tester
Senior ETL Tester

Robotic Process Automation LLC • Boston (MA)

On-site
USD 86,000 - 123,000