Cloud Data Engineer: Ab Initio to GCP Modernization

Strategic Staffing Solutions; Charlotte (NC); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Strategic Staffing Solutions seeks an Ab Initio Developer to design, develop, and modernize data pipelines across on-premises and Google Cloud Platform. You will migrate legacy Teradata and Ab Initio solutions, ensure data quality, security, and scalability, and lead data-engineering efforts with modern orchestration and governance.

The role emphasizes ETL development, BigQuery modeling, and collaboration with cross-functional teams to deliver trusted datasets and production-grade pipelines.

Qualifications

• 4+ years of professional Data Engineering experience.
• 4+ years of experience with PL/SQL and SQL, including complex query development, optimization, and troubleshooting.
• Hands-on experience with Oracle, Teradata, Python, and/or Google BigQuery.
• 4+ years of experience developing enterprise ETL solutions using Ab Initio, including graph development, Psets, and performance tuning.
• 3+ years of experience programming in Python with hands-on PySpark development.
• 3+ years of experience with ETL architecture, data warehousing concepts, dimensional modeling, and data integration best practices.
• Experience building scalable batch and near real-time data processing solutions.
• Strong understanding of enterprise data governance, metadata management, and data lifecycle management.
• Must-have: Use AI-assisted coding tools (e.g., GitHub Copilot, Devin, or similar) to accelerate development while maintaining strong code review discipline, testing, and secure coding standards

Responsibilities

• Design, develop, and maintain scalable data pipelines using Ab Initio, Python, PySpark, PL/SQL, and SQL.
• Build and optimize Google BigQuery datasets, transformations, and data models using partitioning, clustering, and query optimization techniques.
• Support migration initiatives from Teradata and Ab Initio to Google Cloud Platform, including data validation, reconciliation, parallel processing, and production cutovers.
• Develop and maintain workflow orchestration using Autosys, while driving modernization to Google Cloud Composer (Apache Airflow).
• Implement metadata management, governance, and data discovery using Google Dataplex.
• Build and maintain enterprise data quality controls using Informatica Data Quality, including profiling, validation rules, exception handling, and quality monitoring.
• Monitor production pipelines, troubleshoot failures, perform root cause analysis, and implement continuous improvements to system reliability and performance.
• Apply secure data engineering practices including PII protection, data masking, access controls, retention policies, and audit documentation.
• Partner with Product Owners, Architects, Analysts, and Engineering teams to define technical solutions and deliver curated, trusted datasets.
• Create and maintain technical documentation including data dictionaries, reconciliation documents, operational runbooks, and technical specifications.
• Utilize AI-assisted development tools such as GitHub Copilot, Devin, or similar to improve engineering productivity while maintaining secure coding practices, code reviews, and testing standards.
• Provide technical leadership and mentor junior engineers by promoting engineering best practices and scalable solution design.
• Analyze complex business requirements and translate them into robust ETL and data engineering solutions.

Skills

ETL development

Cloud data engineering

Data pipelines

Data governance

AI-assisted coding

Tools

Ab Initio

Python

PySpark

PL/SQL

SQL

Oracle

Teradata

BigQuery

Autosys

Apache Airflow

Dataplex

Informatica Data Quality

GitHub Copilot

Devin

Job description

Strategic Staffing Solutions seeks an Ab Initio Developer to design, develop, and modernize data pipelines across on-premises and Google Cloud Platform. You will migrate legacy Teradata and Ab Initio solutions, ensure data quality, security, and scalability, and lead data-engineering efforts with modern orchestration and governance.

The role emphasizes ETL development, BigQuery modeling, and collaboration with cross-functional teams to deliver trusted datasets and production-grade pipelines.