ETL Automation Lead / Engineer

CloudBigD

Tampa (FL)

On-site

USD 98,000 - 134,000

Full time

11 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CloudBigD in Tampa, FL seeks an experienced ETL Automation Lead/Engineer to design and implement automated testing for Ab Initio ETL workflows. You will build Python/PySpark automation, validate large data sets, and perform comprehensive ETL validations across multiple environments.

Lead candidates mentor teammates and establish testing standards. The role focuses on end-to-end testing, data reconciliation, and improving automation coverage to reduce manual testing efforts.

Qualifications

  • Experience in Ab Initio ETL automation testing.
  • Proficient Python scripting for ETL test automation.
  • Strong SQL/Oracle skills with complex queries.
  • Unix shell scripting for test automation.
  • Hive/Big Data validation and data-quality checks.
  • End-to-end ETL testing including reconciliation.

Responsibilities

  • Design, develop, and maintain automated test solutions for Ab Initio ETL apps.
  • Build reusable automation scripts and frameworks with Python and PySpark.
  • Perform source-to-target data validation and reconciliation.
  • Validate large datasets across Ab Initio, Hive, Oracle, and Big Data envs.
  • Develop complex SQL queries for backend/ETL validation.
  • Create Unix shell scripts to support test automation.
  • Conduct end-to-end, functional, regression, and integration testing.
  • Analyze Ab Initio job failures and root causes; mentor junior members for Lead level.

Skills

Ab Initio ETL automation
Python scripting
PySpark scripting
SQL & Oracle
Unix shell scripting
Hive & Big Data validation
Source-to-target data validation
ETL regression testing
Data reconciliation

Tools

Ab Initio Control Center
Selenium
Java

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: ETL Automation Lead / Engineer
Location: Tampa, FL
Duration: 10 Months + Extension
Bill Rate: $84/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description

We are seeking an experienced ETL Automation Test Engineer with strong expertise in Ab Initio ETL testing, Python, PySpark, SQL, and Big Data validation. The candidate will be responsible for developing automated testing solutions, validating large-volume datasets, performing data reconciliation, and ensuring the accuracy and quality of ETL workflows.

Key Responsibilities:
  • Design, develop, and maintain automated test solutions for Ab Initio ETL applications.
  • Build reusable automation scripts and frameworks using Python and PySpark.
  • Perform source-to-target, data transformation, reconciliation, and data-quality validation.
  • Validate large datasets across Ab Initio, Hive, Oracle, and Big Data environments.
  • Develop complex SQL queries for backend and ETL data validation.
  • Create Unix Shell scripts to support test automation and batch validation.
  • Perform end-to-end, functional, regression, and integration testing.
  • Analyze Ab Initio job failures, investigate data discrepancies, and perform root-cause analysis.
  • Improve automation coverage and reduce manual testing efforts.
  • Collaborate with developers, data engineers, business analysts, and QA teams.
  • For Lead-level candidates, provide technical guidance, review automation scripts, establish testing standards, and mentor team members.
Mandatory Technical Skills:
  • Strong hands-on experience in Ab Initio ETL Automation Testing.
  • Python scripting for ETL test automation.
  • PySpark scripting for large-volume data validation.
  • Strong SQL and Oracle knowledge, including complex queries and data reconciliation.
  • Unix and Unix Shell Scripting.
  • Hive and Big Data validation.
  • Source-to-target data validation and transformation testing.
  • ETL regression testing, data reconciliation, and data-quality validation.
Preferred Skills:
  • Java and Selenium Automation.
  • Working knowledge of Ab Initio Control Center.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Quantum Technologies. LLC • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Valiant Technologies LLC • Tampa (FL)

On-site
USD 95,000 - 136,000
Senior ETL Tester
Senior ETL Tester

Quantum Technologies LLC • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Valiant Technologies LLC • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Robotics Technologies • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

CloudBigD • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Ethereum Technologies LLC • Boston (MA)

On-site
USD 90,000 - 120,000
Senior ETL Tester
Senior ETL Tester

Robotic Process Automation LLC • Boston (MA)

On-site
USD 86,000 - 123,000