ETL & Data Pipeline Engineer (Ab Initio + Python)

Staffing Spot, Inc.; Charlotte (NC); On-site; USD 115,000 - 165,000; Full time

Job summary

Staffing Spot, Inc. in Charlotte, NC is seeking a Mid-Level Software Engineer / Data Engineer to design and implement scalable data pipelines and ETL solutions on-site. You will work with Ab Initio, Python, PySpark, SQL/PLSQL, and cloud migration tasks in a fast-paced enterprise environment.

The role requires hands-on experience with Oracle, Teradata, BigQuery, GCP, and multiple orchestration tools. You will collaborate with product owners and engineers to deliver robust data capabilities and

Qualifications

• 5+ years of Data Engineering / ETL development experience or equivalent.
• 4+ years of Ab Initio development including graphs and performance tuning.
• Strong UNIX/Linux Shell Scripting experience.
• 3+ years of Python development experience.

Responsibilities

• Design, develop, maintain, and optimize scalable batch and near-real-time data pipelines.
• Develop complex ETL solutions using Ab Initio, Python, PySpark, SQL, and PL/SQL.
• Build and maintain Ab Initio graphs, Psets, and reusable components.
• Perform data integration, cleansing, normalization, transformation, and validation across source systems.
• Translate designs into high-quality production code.
• Develop complex SQL/PL/SQL queries and performance tuning.
• Work with Oracle, Teradata, BigQuery, and other platforms.
• Support migration of legacy data-processing to cloud-native technologies (GCP).
• Build, schedule, orchestrate, and deploy data solutions via CI/CD pipelines.
• Work with AutoSys, Airflow, and/or Cloud Composer for scheduling.
• Participate in code reviews, automated testing, and Git workflows.
• Monitor pipelines, troubleshoot, perform root-cause analyses, and meet SLAs.
• Collaborate with Product Owners, Architects, Engineers, and stakeholders.
• Contribute to data governance, lineage, and operational excellence initiatives.
• Explore modernization of Ab Initio workloads using Python, Spark, and SQL patterns.
• Utilize AI-assisted tooling while ensuring security and quality.

Skills

Data Engineering

ETL Development

Batch Processing

Real-time Data Pipelines

Tools

Ab Initio

Python

UNIX Shell Scripting

PySpark

SQL

PL/SQL

Oracle

Teradata

BigQuery

GCP

Cloud Composer

Airflow

AutoSys

Jenkins

Harness

uDeploy

Git

Informatica Data Quality

Job description

Staffing Spot, Inc. in Charlotte, NC is seeking a Mid-Level Software Engineer / Data Engineer to design and implement scalable data pipelines and ETL solutions on-site. You will work with Ab Initio, Python, PySpark, SQL/PLSQL, and cloud migration tasks in a fast-paced enterprise environment.

The role requires hands-on experience with Oracle, Teradata, BigQuery, GCP, and multiple orchestration tools. You will collaborate with product owners and engineers to deliver robust data capabilities and