Hybrid AWS Data Engineer - Real-Time Data Pipelines

Capgemini; New York (NY); On-site; USD 79,000 - 95,000; Full time

Job summary

Capgemini is seeking an AWS Data Engineer to design, build, and maintain scalable cloud-based data solutions on AWS. The role emphasizes designing data pipelines, managing data lakes/warehouses, and ensuring secure, high-quality data platforms for analytics, BI, and ML initiatives.

Based in Whippany, NJ, the position is onsite with hybrid from day 1. You will collaborate with data scientists, analysts, and stakeholders to deliver scalable data solutions using S3, Redshift, Glue, Spark, and

Qualifications

• Bachelor's degree or higher in CS/IT/Engineering or related field.
• 5+ years of data engineering and cloud-based data platforms.
• Strong hands-on experience with AWS data services and cloud architecture.
• Proficiency in Python, SQL, Spark, and ETL/ELT development.
• Experience with Redshift, Snowflake, data lakes, and real-time data processing frameworks.
• Knowledge of Terraform/CloudFormation, CI/CD pipelines, and DevOps practices.
• Strong problem-solving, communication, and stakeholder management skills.

Responsibilities

• Design and implement scalable data architectures using AWS services (S3, Redshift, Glue, Athena, EMR, DynamoDB, Lambda, Kinesis).
• Build, optimize, and maintain ETL/ELT pipelines for structured and unstructured data.
• Develop real-time and batch data ingestion solutions using AWS-native technologies and Kafka.
• Utilize Python, Spark, Scala, AWS Glue, and EMR for data processing and transformation.
• Build and manage data lakes on S3 and data warehouses on Redshift or Snowflake.
• Monitor and optimize data models, performance, and storage strategies.

Skills

Problem-solving

Communication skills

Stakeholder management

Team collaboration

Education

Bachelor's degree in Computer Science/IT/Engineering

Tools

AWS

Python

SQL

Spark

ETL/ELT

Redshift

Snowflake

Terraform/CloudFormation

CI/CD

Kafka

DynamoDB

Job description

Capgemini is seeking an AWS Data Engineer to design, build, and maintain scalable cloud-based data solutions on AWS. The role emphasizes designing data pipelines, managing data lakes/warehouses, and ensuring secure, high-quality data platforms for analytics, BI, and ML initiatives.

Based in Whippany, NJ, the position is onsite with hybrid from day 1. You will collaborate with data scientists, analysts, and stakeholders to deliver scalable data solutions using S3, Redshift, Glue, Spark, and