ETL Developer / Data Engineer

Staffing Spot, Inc.; Charlotte (NC); On-site; USD 115,000 - 165,000; Full time

Job summary

Staffing Spot, Inc. in Charlotte, NC is seeking a Mid-Level Software Engineer / Data Engineer to design and implement scalable data pipelines and ETL solutions on-site. You will work with Ab Initio, Python, PySpark, SQL/PLSQL, and cloud migration tasks in a fast-paced enterprise environment.

The role requires hands-on experience with Oracle, Teradata, BigQuery, GCP, and multiple orchestration tools. You will collaborate with product owners and engineers to deliver robust data capabilities and

Qualifications

• 5+ years of Data Engineering / ETL development experience or equivalent.
• 4+ years of Ab Initio development including graphs and performance tuning.
• Strong UNIX/Linux Shell Scripting experience.
• 3+ years of Python development experience.

Responsibilities

• Design, develop, maintain, and optimize scalable batch and near-real-time data pipelines.
• Develop complex ETL solutions using Ab Initio, Python, PySpark, SQL, and PL/SQL.
• Build and maintain Ab Initio graphs, Psets, and reusable components.
• Perform data integration, cleansing, normalization, transformation, and validation across source systems.
• Translate designs into high-quality production code.
• Develop complex SQL/PL/SQL queries and performance tuning.
• Work with Oracle, Teradata, BigQuery, and other platforms.
• Support migration of legacy data-processing to cloud-native technologies (GCP).
• Build, schedule, orchestrate, and deploy data solutions via CI/CD pipelines.
• Work with AutoSys, Airflow, and/or Cloud Composer for scheduling.
• Participate in code reviews, automated testing, and Git workflows.
• Monitor pipelines, troubleshoot, perform root-cause analyses, and meet SLAs.
• Collaborate with Product Owners, Architects, Engineers, and stakeholders.
• Contribute to data governance, lineage, and operational excellence initiatives.
• Explore modernization of Ab Initio workloads using Python, Spark, and SQL patterns.
• Utilize AI-assisted tooling while ensuring security and quality.

Skills

Data Engineering

ETL Development

Batch Processing

Real-time Data Pipelines

Tools

Ab Initio

Python

UNIX Shell Scripting

PySpark

SQL

PL/SQL

Oracle

Teradata

BigQuery

GCP

Cloud Composer

Airflow

AutoSys

Jenkins

Harness

uDeploy

Git

Informatica Data Quality

Job description

Position Overview

We are seeking a

Location: Charlotte, NC

Work Arrangement: 5 days/week onsite

Employment Type: Contract

Position Overview

We are seeking a Mid-Level Software Engineer / Data Engineer with strong hands-on experience in Ab Initio, Python, UNIX Shell Scripting, SQL/PLSQL, and enterprise ETL development.

Key Responsibilities

• Design, develop, maintain, and optimize scalable batch and near-real-time data pipelines.
• Develop complex ETL solutions using Ab Initio, Python, PySpark, SQL, and PL/SQL.
• Build and maintain complex Ab Initio graphs, Psets, and reusable components.
• Perform data integration, cleansing, normalization, transformation, and validation across multiple source systems.
• Translate technical designs and solution blueprints into high-quality, reusable production code.
• Develop complex SQL/PLSQL queries and perform query and pipeline performance tuning.
• Work with Oracle, Teradata, BigQuery, and other enterprise data platforms.
• Support migration and modernization of legacy data-processing solutions to GCP and cloud-native technologies.
• Build, schedule, orchestrate, and deploy data solutions through enterprise CI/CD pipelines.
• Work with AutoSys, Airflow, and/or Cloud Composer for job scheduling and orchestration.
• Participate in code reviews, automated testing, deployment, and Git-based development workflows.
• Monitor production data pipelines, troubleshoot issues, perform root-cause analysis, and support SLA-driven operations.
• Collaborate with Product Owners, Architects, Engineers, and business stakeholders.
• Contribute to data quality, governance, metadata, lineage, and operational excellence initiatives.
• Evaluate opportunities to modernize Ab Initio workloads using Python, PySpark, Spark, and SQL patterns.
• Use AI-assisted development tools appropriately to improve engineering productivity while maintaining security and code-quality standards.

Required Qualifications

• 5+ years of Data Engineering / ETL development experience or equivalent combination of education, training, and professional experience.
• 4+ years of hands-on Ab Initio development, including complex graphs, Psets, debugging, and performance tuning.
• Strong UNIX/Linux Shell Scripting experience.
• 3+ years of Python development experience.
• Hands-on experience with PySpark and distributed data processing.
• 4+ years of SQL and PL/SQL development experience.
• Strong experience with Oracle and/or Teradata.
• Experience with complex query development, debugging, and performance tuning.
• 3+ years of ETL development, ETL design, data warehousing, and data modeling experience.
• Experience developing and supporting production-grade enterprise data pipelines.
• Strong understanding of data integration, transformation, cleansing, and reconciliation processes.

Preferred Qualifications

• Financial services or mortgage industry experience.
• Experience supporting production applications, including monitoring, SLAs, incident management, root-cause analysis, and performance optimization.
• Experience working in hybrid on-premises and cloud environments.
• Experience with GCP, BigQuery, and Dataplex.
• Experience migrating legacy ETL/data platforms to cloud-native solutions.
• Experience with AutoSys, Airflow, or Google Cloud Composer.
• Experience with Jenkins, Harness, and/or uDeploy.
• Strong Git-based development, code review, and automated testing experience.
• Experience migrating or converting Ab Initio graphs to Spark/PySpark/SQL-based solutions.
• Experience with Informatica Data Quality, including profiling, rules, scorecards, metrics, and exception workflows.
• Understanding of data governance concepts such as metadata, classification, stewardship, and lineage.
• Experience designing near-real-time or micro-batch data processing patterns.
• Understanding of late-arriving and out-of-order data handling.
• Familiarity with GCP operational concepts including IAM/service accounts, job monitoring, quotas, and cost controls.
• Experience using AI-assisted coding tools in day-to-day development while following enterprise security and quality standards.

Technical Environment

• ETL & Data Engineering: Ab Initio, ETL, Data Warehousing, Data Modeling
• Programming: Python, PySpark, SQL, PL/SQL, UNIX Shell
• Databases: Oracle, Teradata, BigQuery
• Cloud: Google Cloud Platform (GCP), BigQuery, Dataplex
• Orchestration: AutoSys, Airflow, Cloud Composer
• CI/CD: Jenkins, Harness, uDeploy, Git
• Data Quality & Governance: Informatica Data Quality, Data Profiling, Metadata, Classification, Lineage

What We Value

We are looking beyond job titles and keyword matches. Strong candidates should be able to clearly demonstrate:

• What they have actually built and delivered.
• The business problems their solutions addressed.
• Their level of hands-on technical ownership.
• Experience working with complex enterprise data environments.
• Strong ETL, data integration, and data transformation expertise.
• Experience contributing to modernization and cloud migration initiatives.
• The ability to learn, adapt, and work effectively across evolving technologies.