ETL Automation Lead — Ab Initio & PySpark Expert

CloudBigD

Tampa (FL)

On-site

USD 98,000 - 134,000

Full time

11 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CloudBigD in Tampa, FL seeks an experienced ETL Automation Lead/Engineer to design and implement automated testing for Ab Initio ETL workflows. You will build Python/PySpark automation, validate large data sets, and perform comprehensive ETL validations across multiple environments.

Lead candidates mentor teammates and establish testing standards. The role focuses on end-to-end testing, data reconciliation, and improving automation coverage to reduce manual testing efforts.

Qualifications

  • Experience in Ab Initio ETL automation testing.
  • Proficient Python scripting for ETL test automation.
  • Strong SQL/Oracle skills with complex queries.
  • Unix shell scripting for test automation.
  • Hive/Big Data validation and data-quality checks.
  • End-to-end ETL testing including reconciliation.

Responsibilities

  • Design, develop, and maintain automated test solutions for Ab Initio ETL apps.
  • Build reusable automation scripts and frameworks with Python and PySpark.
  • Perform source-to-target data validation and reconciliation.
  • Validate large datasets across Ab Initio, Hive, Oracle, and Big Data envs.
  • Develop complex SQL queries for backend/ETL validation.
  • Create Unix shell scripts to support test automation.
  • Conduct end-to-end, functional, regression, and integration testing.
  • Analyze Ab Initio job failures and root causes; mentor junior members for Lead level.

Skills

Ab Initio ETL automation
Python scripting
PySpark scripting
SQL & Oracle
Unix shell scripting
Hive & Big Data validation
Source-to-target data validation
ETL regression testing
Data reconciliation

Tools

Ab Initio Control Center
Selenium
Java

Job description

CloudBigD in Tampa, FL seeks an experienced ETL Automation Lead/Engineer to design and implement automated testing for Ab Initio ETL workflows. You will build Python/PySpark automation, validate large data sets, and perform comprehensive ETL validations across multiple environments.

Lead candidates mentor teammates and establish testing standards. The role focuses on end-to-end testing, data reconciliation, and improving automation coverage to reduce manual testing efforts.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Automation Lead • Ab Initio & PySpark QA
ETL Automation Lead • Ab Initio & PySpark QA

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead — Ab Initio & Big Data QA
ETL Automation Lead — Ab Initio & Big Data QA

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
Senior ETL Automation Lead — Ab Initio & Big Data
Senior ETL Automation Lead — Ab Initio & Big Data

Valiant Technologies LLC • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead - Big Data Testing & Validation
ETL Automation Lead - Big Data Testing & Validation

Quantum Technologies. LLC • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

CloudBigD • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Quantum Technologies. LLC • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Valiant Technologies LLC • Tampa (FL)

On-site
USD 95,000 - 136,000
Senior ETL Automation Tester | PySpark & Data Quality
Senior ETL Automation Tester | PySpark & Data Quality

CloudBigD • Boston (MA)

On-site
USD 86,000 - 123,000