Senior AWS Data Engineer: Scalable Data Lakes & Pipelines

Capgemini; New York (NY); Hybrid; USD 79,000 - 95,000; Full time

Benefits offered by this job

Paid time off

Health insurance

Retirement plans

Life and disability insurance

Employee assistance programs

Job summary

Capgemini in Whippany, NJ is seeking an AWS Data Engineer to design, build, and maintain scalable cloud data solutions on AWS. You will develop data pipelines, manage data lakes and warehouses, and ensure secure, high‑quality platforms that support analytics, BI, and ML initiatives.

You will use Python, Spark, SQL, and AWS services to implement ETL/ELT, real-time and batch ingestion, CI/CD with Terraform/CloudFormation, and data governance.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
• 5+ years of experience in data engineering and cloud-based data platforms.
• Strong hands-on experience with AWS data services and cloud architecture.
• Proficiency in Python, SQL, Spark, and ETL/ELT development.
• Experience with Redshift, Snowflake, data lakes, and real-time data processing frameworks.
• Knowledge of Terraform/CloudFormation, CI/CD pipelines, and DevOps practices.
• Strong problem-solving, communication, and stakeholder management skills.

Responsibilities

• Design and implement scalable data architectures using AWS services such as S3, Redshift, Glue, Athena, EMR, DynamoDB, Lambda, and Kinesis.
• Build, optimize, and maintain ETL/ELT pipelines for structured and unstructured data.
• Develop real-time and batch data ingestion solutions using AWS-native technologies and Kafka.
• Utilize Python, Spark, Scala, AWS Glue, and EMR for data processing and transformation.
• Build and manage data lakes on Amazon S3 and data warehouses on Redshift or Snowflake.
• Optimize data models, database performance, partitioning, and storage strategies.
• Implement CI/CD pipelines, Infrastructure-as-Code (Terraform/CloudFormation), and DevOps best practices.
• Monitor and troubleshoot data pipelines, infrastructure, and performance issues using CloudWatch and related AWS services.
• Apply AWS security best practices, including IAM, KMS, VPCs, and Secrets Manager.
• Ensure compliance with data governance, privacy, audit, and regulatory requirements.
• Collaborate with data scientists, analysts, and business stakeholders to deliver scalable data solutions.

Skills

AWS data engineer

Python

SQL

Spark

ETL/ELT

CI/CD

Terraform/CloudFormation

Data governance

Kafka

Cloud architecture

DevOps

Education

Bachelor's degree in CS/IT/Engineering

Tools

AWS S3

Redshift

Glue

Athena

EMR

DynamoDB

Lambda

Kinesis

Snowflake

Terraform

CloudFormation

Airflow

Job description

Capgemini in Whippany, NJ is seeking an AWS Data Engineer to design, build, and maintain scalable cloud data solutions on AWS. You will develop data pipelines, manage data lakes and warehouses, and ensure secure, high‑quality platforms that support analytics, BI, and ML initiatives.

You will use Python, Spark, SQL, and AWS services to implement ETL/ELT, real-time and batch ingestion, CI/CD with Terraform/CloudFormation, and data governance.