AWS Data Engineer - Data Lakes, ETL & Streaming on AWS

Ethereum Technologies; New Jersey; On-site; USD 120,000 - 180,000; Full time

Job summary

Ethereum Technologies in New Jersey is seeking an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines and architectures in the AWS cloud. You will collaborate with data scientists, analysts and business stakeholders to deliver robust data solutions.

Key responsibilities include building ingestion pipelines, ETL/ELT processes, data lake/warehouse architectures, and serverless data applications using AWS services such as Glue, S3, Redshift, Lambda, Kinesis, and

Qualifications

• Five years of experience building data lakes, warehouses and applications on AWS for large enterprises.
• Strong programming experience with Python, SQL and shell scripting.
• Experience with AWS services and serverless data pipelines on AWS.

Responsibilities

• Design and maintain data pipelines and apps on AWS.
• Build ingestion pipelines from on-prem to AWS and within AWS using AWS services.
• Develop and manage ETLELT processes ensuring data quality and security.
• Architect end-to-end data solutions with data lakes and warehouses.
• Participate in architecture discussions for high-scale projects.
• Perform hands-on development, unit testing and code reviews.
• Implement serverless apps using AWS Lambda and Step Functions.
• Migrate data to AWS data lakes (S3) and relational stores (RDS/Aurora, Redshift).
• Implement high-velocity streaming with Kinesis, SQS, Kafka where applicable.
• Design CICD strategies for enterprise data platforms.
• Collaborate with product, operations, QA and cross-functional teams.

Skills

Python

SQL

Shell scripting

ETL/ELT

Data pipelines

Data modeling

Problem solving

Teamwork

Communication

Education

Bachelor's degree in Computer Science / Software Engineering / MIS or equivalent

Tools

AWS CloudFormation

S3

Redshift

Glue

EMR Spark

Kinesis

Lambda

SQS

DynamoDB

Aurora

Job description

Ethereum Technologies in New Jersey is seeking an experienced AWS Data Engineer to design, develop, and maintain scalable data pipelines and architectures in the AWS cloud. You will collaborate with data scientists, analysts and business stakeholders to deliver robust data solutions.

Key responsibilities include building ingestion pipelines, ETL/ELT processes, data lake/warehouse architectures, and serverless data applications using AWS services such as Glue, S3, Redshift, Lambda, Kinesis, and