AWS Data Engineer: Data Lake & Analytics Architect

Capgemini; Newark (NJ); On-site; USD 120,000 - 160,000; Full time

Job summary

Capgemini Newark, NJ seeks a data engineer with strong AWS data lake and data warehouse experience to design and implement end-to-end data solutions. You will work with Python, SQL and shell scripting to ingest, transform, and load large enterprise datasets using S3, Glue, Athena, Redshift, and EMR.

The role requires CI/CD for data pipelines, streaming knowledge (Kinesis, Kafka), and data migrations from APIs and on-prem systems to AWS.

Qualifications

• Bachelor's degree in CS/SE or MIS, or equivalent.
• Experience with AWS data lakes and data warehouses on large enterprises.
• Proficient in Python, Shell scripting and SQL.
• Strong knowledge of AWS services including CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS.

Skills

Python

Shell scripting

SQL

AWS data lakes

AWS data warehouses

CloudFormation

S3

Athena

Glue

EMR/Spark

RDS

Redshift

DynamoDB

Lambda

Step Functions

IAM

KMS

Kinesis

Kafka

APIs data migration

Elasticsearch

Education

Bachelor's degree in Computer Science / Software Engineering / MIS

Job description

Capgemini Newark, NJ seeks a data engineer with strong AWS data lake and data warehouse experience to design and implement end-to-end data solutions. You will work with Python, SQL and shell scripting to ingest, transform, and load large enterprise datasets using S3, Glue, Athena, Redshift, and EMR.

The role requires CI/CD for data pipelines, streaming knowledge (Kinesis, Kafka), and data migrations from APIs and on-prem systems to AWS.