Lead Data Engineer - Production Pipelines & GenAI (Onsite)

AIG PC Global Services, Inc.; Jersey City (NJ); On-site; USD 125,000 - 135,000; Full time

Benefits offered by this job

Eligible bonus

Comprehensive benefits package

Hybrid flexibility

Total Rewards Program

Job summary

AIG PC Global Services, Inc. seeks a Data Engineer Lead in Jersey City, onsite, to build and own production-grade PySpark and Python data pipelines on AWS, while mentoring engineers and upholding high engineering standards.

You will work in an Agile environment, delivering end-to-end data products, shaping data models and SLAs, and applying lakehouse patterns. GenAI tooling will be used to boost quality and speed of delivery.

Qualifications

• Bachelor’s degree or equivalent in a technical field.
• 7+ years of hands-on data engineering delivering production pipelines end-to-end.
• Strong command of PySpark, Python, and SQL including Spark optimization and query performance tuning in Snowflake.
• Hands-on experience with AWS data services: S3, Glue, EMR, Aurora, Lambda, IAM, and CloudWatch.
• Knowledge of lakehouse patterns and fault-tolerant ingestion in practice.
• Clear communication to explain design decisions to technical and business stakeholders.

Responsibilities

• Design, build, and operate production-grade PySpark and Python pipelines on AWS services with data quality checks and observability.
• Own end-to-end delivery of data products from requirements to production readiness in an Agile/Scrum workflow.
• Translate business requirements into technical designs including pipeline structure, data models, and SLAs.
• Enforce engineering standards, coding conventions, and data quality frameworks; drive code reviews and pair programming.
• Utilize GenAI tooling (Claude Code CLI, Snowflake Cortex) to improve quality and delivery speed.
• Mentor junior engineers and produce ADRs, runbooks, and data dictionaries for documentation.

Skills

PySpark

Python

SQL

Data modeling

Data quality

Observability

GenAI tooling

Education

Bachelor’s degree in Computer Science or related field

Tools

AWS EMR

AWS Glue

Amazon S3

Snowflake

Snowflake Cortex

Claude Code

Claude Code CLI

IAM

CloudWatch

Job description

AIG PC Global Services, Inc. seeks a Data Engineer Lead in Jersey City, onsite, to build and own production-grade PySpark and Python data pipelines on AWS, while mentoring engineers and upholding high engineering standards.

You will work in an Agile environment, delivering end-to-end data products, shaping data models and SLAs, and applying lakehouse patterns. GenAI tooling will be used to boost quality and speed of delivery.