AWS Data Engineer - Data Lakes, ETL & Cloud Pipelines

Capgemini; New York (NY); On-site; USD 110,000 - 145,000; Full time

Job summary

Capgemini is looking for an experienced AWS Data Engineer to join their team in New York, NY. The role involves designing, developing, and maintaining scalable data pipelines and cloud-based data solutions on AWS.

The ideal candidate should have a robust background in data engineering, including ETL development and cloud technologies. Additionally, they should be well-versed in big data processing frameworks and proficient in AWS services.

Qualifications

• 3+ years of experience in Data Engineering, working hands-on with AWS cloud services.
• Strong understanding of distributed data processing frameworks.

Responsibilities

• Design, develop, and optimize scalable data pipelines using AWS services.
• Build and maintain ETL/ELT workflows for ingesting, transforming, and loading data.
• Develop data lakes and data warehouses using AWS cloud platforms.

Skills

AWS Glue

Amazon S3

AWS Lambda

Amazon Redshift

AWS EMR

Amazon RDS

AWS Step Functions

Amazon Kinesis

AWS IAM

Amazon CloudWatch

Data Modeling

Data Warehousing concepts

Data Lake architecture

Data Quality and Governance

Python

PySpark

Shell Scripting

Hadoop Ecosystem

Kafka

Git

Terraform

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or related field

Job description

Capgemini is looking for an experienced AWS Data Engineer to join their team in New York, NY. The role involves designing, developing, and maintaining scalable data pipelines and cloud-based data solutions on AWS.

The ideal candidate should have a robust background in data engineering, including ETL development and cloud technologies. Additionally, they should be well-versed in big data processing frameworks and proficient in AWS services.