ETL Automation Lead / Engineer

Valiant Technologies LLC

Tampa (FL)

On-site

USD 95,000 - 136,000

Full time

12 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Valiant Technologies LLC in Tampa, FL is seeking an experienced ETL Automation Lead/Engineer to design and implement automated testing for Ab Initio ETL workflows. The role focuses on Python and PySpark-based automation, data validation, and SQL/Oracle-backed data integrity checks across Big Data environments.

The candidate will develop scalable automation frameworks, validate large datasets, and collaborate with data engineers and QA teams.

Qualifications

  • Experience in Ab Initio ETL automation testing.
  • Proficient in Python scripting for ETL test automation.
  • Proficient in PySpark for large-volume data validation.
  • Strong SQL and Oracle knowledge with complex queries and data reconciliation.
  • Experience with Unix and Unix Shell scripting.
  • Experience with Hive and Big Data validation.
  • Experience with source-to-target data validation and transformation testing.
  • Experience in ETL regression testing and data-quality validation.

Responsibilities

  • Design, develop, and maintain automated test solutions for Ab Initio ETL applications.
  • Build reusable automation scripts using Python and PySpark.
  • Perform source-to-target data validation and data-quality validation.
  • Validate large datasets across Ab Initio, Hive, Oracle, and Big Data environments.
  • Develop complex SQL queries for backend ETL validation.
  • Create Unix Shell scripts to support test automation.
  • Conduct end-to-end, functional, regression, and integration testing.
  • Analyze Ab Initio job failures and investigate data discrepancies.

Skills

Ab Initio ETL Testing
Python scripting
PySpark scripting

Tools

Ab Initio
Python
PySpark
SQL
Oracle
Unix Shell
Hive

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title:ETL Automation Lead / Engineer

Location:Tampa, FL

Duration: 10 Months + Extension

Bill Rate: $84/hour

Job Type: W-2, 1099, C2C

Client: To Be Discussed Later

Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description

We are seeking an experienced ETL Automation Test Engineer with strong expertise in Ab Initio ETL testing, Python, PySpark, SQL, and Big Data validation. The candidate will be responsible for developing automated testing solutions, validating large-volume datasets, performing data reconciliation, and ensuring the accuracy and quality of ETL workflows.

Key Responsibilities:
  • Design, develop, and maintain automated test solutions for Ab Initio ETL applications.
  • Build reusable automation scripts and frameworks using Python and PySpark.
  • Perform source-to-target, data transformation, reconciliation, and data-quality validation.
  • Validate large datasets across Ab Initio, Hive, Oracle, and Big Data environments.
  • Develop complex SQL queries for backend and ETL data validation.
  • Create Unix Shell scripts to support test automation and batch validation.
  • Perform end-to-end, functional, regression, and integration testing.
  • Analyze Ab Initio job failures, investigate data discrepancies, and perform root-cause analysis.
  • Improve automation coverage and reduce manual testing efforts.
  • Collaborate with developers, data engineers, business analysts, and QA teams.
  • For Lead-level candidates, provide technical guidance, review automation scripts, establish testing standards, and mentor team members.
Mandatory Technical Skills:
  • Strong hands-on experience in Ab Initio ETL Automation Testing.
  • Python scripting for ETL test automation.
  • PySpark scripting for large-volume data validation.
  • Strong SQL and Oracle knowledge, including complex queries and data reconciliation.
  • Unix and Unix Shell Scripting.
  • Hive and Big Data validation.
  • Source-to-target data validation and transformation testing.
  • ETL regression testing, data reconciliation, and data-quality validation.
Preferred Skills:
  • Java and Selenium Automation.
  • Working knowledge of Ab Initio Control Center.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Robotic Technologies Automation • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

CloudBigD • Tampa (FL)

On-site
USD 98,000 - 134,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Ethereum Technologies • Tampa (FL)

On-site
USD 95,000 - 136,000
ETL Automation Lead / Engineer
ETL Automation Lead / Engineer

Quantum Technologies. LLC • Tampa (FL)

On-site
USD 98,000 - 134,000
Senior ETL Tester
Senior ETL Tester

Ethereum Technologies LLC • Boston (MA)

On-site
USD 90,000 - 120,000
Senior ETL Tester
Senior ETL Tester

Robotic Process Automation LLC • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Valiant Technologies LLC • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

CloudBigD • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Quantum Technologies LLC • Boston (MA)

On-site
USD 86,000 - 123,000
Senior ETL Tester
Senior ETL Tester

Robotics Technologies • Boston (MA)

On-site
USD 86,000 - 123,000