Senior ETL Automation Lead — Ab Initio & Big Data

Valiant Technologies LLC

Tampa (FL)

On-site

USD 95,000 - 136,000

Full time

14 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC in Tampa, FL is seeking an experienced ETL Automation Lead/Engineer to design and implement automated testing for Ab Initio ETL workflows. The role focuses on Python and PySpark-based automation, data validation, and SQL/Oracle-backed data integrity checks across Big Data environments.

The candidate will develop scalable automation frameworks, validate large datasets, and collaborate with data engineers and QA teams.

Qualifications

  • Experience in Ab Initio ETL automation testing.
  • Proficient in Python scripting for ETL test automation.
  • Proficient in PySpark for large-volume data validation.
  • Strong SQL and Oracle knowledge with complex queries and data reconciliation.
  • Experience with Unix and Unix Shell scripting.
  • Experience with Hive and Big Data validation.
  • Experience with source-to-target data validation and transformation testing.
  • Experience in ETL regression testing and data-quality validation.

Responsibilities

  • Design, develop, and maintain automated test solutions for Ab Initio ETL applications.
  • Build reusable automation scripts using Python and PySpark.
  • Perform source-to-target data validation and data-quality validation.
  • Validate large datasets across Ab Initio, Hive, Oracle, and Big Data environments.
  • Develop complex SQL queries for backend ETL validation.
  • Create Unix Shell scripts to support test automation.
  • Conduct end-to-end, functional, regression, and integration testing.
  • Analyze Ab Initio job failures and investigate data discrepancies.

Skills

Ab Initio ETL Testing
Python scripting
PySpark scripting

Tools

Ab Initio
Python
PySpark
SQL
Oracle
Unix Shell
Hive

Job description

Valiant Technologies LLC in Tampa, FL is seeking an experienced ETL Automation Lead/Engineer to design and implement automated testing for Ab Initio ETL workflows. The role focuses on Python and PySpark-based automation, data validation, and SQL/Oracle-backed data integrity checks across Big Data environments.

The candidate will develop scalable automation frameworks, validate large datasets, and collaborate with data engineers and QA teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Automation Lead — Ab Initio & PySpark Expert
ETL Automation Lead — Ab Initio & PySpark Expert

CloudBigD • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead — Ab Initio & Big Data QA
ETL Automation Lead — Ab Initio & Big Data QA

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead • Ab Initio & PySpark QA
ETL Automation Lead • Ab Initio & PySpark QA

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead - Big Data Testing & Validation
ETL Automation Lead - Big Data Testing & Validation

Quantum Technologies. LLC • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Valiant Technologies LLC • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

CloudBigD • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Quantum Technologies. LLC • Tampa (FL)

On-site
USD 98,000 - 134,000
Senior Ab Initio Data Lineage & ETL Architect
Senior Ab Initio Data Lineage & ETL Architect

Programmers • Tampa (FL)

On-site
USD 100,000 - 140,000