Lead AWS Data Engineer

Experis Technology Group; New Hanover Township (NJ); On-site; USD 65,000 - 87,000; Full time

Benefits offered by this job

Medical and Prescription Drug Plans

Dental Plan

Vision Plan

Health Savings Account

Health Flexible Spending Account

Dependent Care Flexible Spending Plan

Supplemental Life Insurance

Short Term and Long Term Disability

Business Travel Insurance

401(k), Plus Match

Weekly Pay

Job summary

Experis Technology Group in Hanover, NJ is seeking a Lead AWS Data Engineer to join our engineering organization supporting Data Platform delivery. Lead architecture design of AWS-based data platforms and provide mentorship to engineering teams, ensuring adherence to CI/CD practices and engineering standards.

Proficiency in Python (PySpark), SQL, and shell scripting is required, along with hands-on experience with Glue, Lambda, Step Functions, S3, Athena and Redshift, and Iceberg-based data

Qualifications

• Strong hands-on expertise with AWS Glue, AWS Lambda, AWS Step Functions, Amazon S3, Amazon Athena, and Amazon Redshift.
• Experience building enterprise data lakes with Apache Iceberg, including partitioning, schema evolution, compaction, and time travel concepts.
• ETL/ELT frameworks and modern data engineering practices, including data quality governance and security compliance.
• Python (PySpark preferred), SQL, and shell scripting proficiency.
• DevOps automation and CI/CD using IaC (Terraform, CloudFormation, or AWS CDK) and deployment tooling (GitHub Actions, Jenkins, or AWS CodePipeline), with CloudWatch monitoring.

Responsibilities

• Lead architecture design and implementation of scalable AWS-based data platforms.
• Provide technical direction and mentorship to engineering teams, including standards, coding best practices, and CI/CD processes.
• Drive design reviews, code reviews, and architecture governance for high-quality solutions.
• Design and develop data ingestion, transformation, and orchestration pipelines using AWS services (Glue, Lambda, Step Functions).
• Architect secure, scalable data lake solutions using Iceberg on S3 for batch and near real-time processing.

Skills

Python

PySpark

SQL

Shell scripting

CI/CD

Data governance

Security compliance

Tools

AWS Glue

AWS Lambda

AWS Step Functions

Amazon S3

Amazon Athena

Amazon Redshift

Apache Iceberg

Terraform

CloudFormation

AWS CDK

GitHub Actions

Jenkins

AWS CodePipeline

CloudWatch

Job description

Our client is seeking a Lead AWS Data Engineer to join their team. As a Lead AWS Data Engineer, you will be part of the Engineering organization supporting Data Platform delivery.

Job Title: Lead AWS Data Engineer

Location: Hanover, NJ

Pay Range: $55 per hour on W2

What's the Job?

• Lead architecture design and implementation of scalable AWS-based, cloud-native data platforms.
• Provide technical direction and mentorship to engineering teams, including engineering standards, coding best practices, and CI/CD processes.
• Drive design reviews, code reviews, and architecture governance to ensure high-quality, reliable solutions.
• Design and develop data ingestion, transformation, and orchestration pipelines using AWS services (including AWS Glue, AWS Lambda, and AWS Step Functions).
• Architect secure, highly available, scalable, and cost-efficient data lake solutions using Apache Iceberg on Amazon S3, supporting large-scale batch and near real-time processing.

What's Needed?

• Strong hands-on expertise with AWS Glue, AWS Lambda, AWS Step Functions, Amazon S3, Amazon Athena, and Amazon Redshift.
• Proven experience building enterprise data lakes with Apache Iceberg, including partitioning strategies, schema evolution, compaction, and time travel concepts.
• Expertise in ETL/ELT frameworks and modern data engineering practices, including data quality governance and security compliance.
• Strong programming skills in Python (PySpark preferred), along with SQL and shell scripting.
• Experience with DevOps automation and CI/CD using Infrastructure as Code (Terraform, CloudFormation, or AWS CDK) and deployment tooling (GitHub Actions, Jenkins, or AWS CodePipeline), plus monitoring with CloudWatch.

What's in it for me?

• Opportunity to lead enterprise-scale AWS data platform architecture and delivery.
• Work on modern, cloud-native data lake solutions using Apache Iceberg and serverless orchestration.
• Collaborate with product, architecture, and business stakeholders to translate requirements into scalable technology.
• Contribute to engineering governance through design reviews, code reviews, and best-practice standards.
• Build and improve operational excellence through monitoring, automation, and reliable deployment pipelines.

Upon completion of waiting period consultants are eligible for:

• Medical and Prescription Drug Plans
• Dental Plan
• Vision Plan
• Health Savings Account
• Health Flexible Spending Account
• Dependent Care Flexible Spending Account
• Supplemental Life Insurance
• Short Term and Long Term Disability Insurance
• Business Travel Insurance
• 401(k), Plus Match
• Weekly Pay