Data Engineer: Ab Initio to BigQuery & Cloud Composer

Sapear Inc; Charlotte (NC); On-site; USD 110,000 - 170,000; Full time

Job summary

Sapear Inc. seeks a data engineer to build scalable batch and streaming pipelines across on-prem and Google Cloud environments. You will modernize legacy Teradata and Ab Initio workflows by migrating them to BigQuery and Cloud Composer, leveraging PySpark and SQL skills to ensure robust ETL design.

The role requires 4+ years in data engineering, with expertise in Ab Initio, PL/SQL, Python/PySpark, and experience with cloud data platforms.

Qualifications

• 4+ years of experience in Data Engineering with Ab Initio, PL/SQL and Python/PySpark.
• Proficient in ETL design, data warehousing, and AI-assisted coding tools.

Responsibilities

• Build and maintain scalable batch and near real-time data pipelines across on-prem and Google Cloud.
• Lead modernization and migration of legacy Teradata/Ab Initio workflows to BigQuery and Cloud Composer.

Skills

Ab Initio

Unix Shell Scripting

Python

PySpark

Oracle PL/SQL

Teradata

CI/CD

Google Cloud Platform

BigQuery

Google Cloud Composer

Informatica Data Quality

Dataplex

Autosys

Airflow

SQL

Data Modeling

Job description

Sapear Inc. seeks a data engineer to build scalable batch and streaming pipelines across on-prem and Google Cloud environments. You will modernize legacy Teradata and Ab Initio workflows by migrating them to BigQuery and Cloud Composer, leveraging PySpark and SQL skills to ensure robust ETL design.

The role requires 4+ years in data engineering, with expertise in Ab Initio, PL/SQL, Python/PySpark, and experience with cloud data platforms.