Senior AWS Data Engineer & Data Lake Architect

Cloud Analytics Technologies, LLC; Newark (NJ); In loco; USD 140.000 - 190.000; Tempo pieno

Descrizione del lavoro

Cloud Analytics Technologies, LLC seeks an experienced AWS Data Engineer to join the Data Engineering team in Newark. You will implement and manage scalable data solutions on AWS, mentor engineers, and collaborate with cross-functional partners to ensure best practices in cloud data engineering.

You will design end-to-end data pipelines, oversee data migration to data lakes and warehouses, and lead efforts in data quality, security, and governance while adopting DevOps and IaC practices.

Competenze

• Bachelor's or master's degree in computer science, engineering, or related field.
• 6+ years of data engineering experience with at least 3 years in technical leadership.
• Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway).
• Proficient in Python and SQL; Shell scripting and Scala a plus.
• Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
• Proven ETL/ELT, data modeling, and big data frameworks.
• Demonstrated ability to lead, mentor, and coach engineers; DevOps, CI/CD, and Infrastructure-as-Code (CloudFormation, Terraform).
• Excellent problem-solving, communication, and organizational skills.

Mansioni

• Lead design, development, and optimization of large-scale data pipelines and data lake architecture on AWS.
• Architect end-to-end data solutions including ingestion, storage, transformation, and analytics using AWS services.
• Mentor a team of data engineers and conduct code reviews.
• Collaborate with data scientists, analysts, and stakeholders to translate requirements into scalable solutions.
• Oversee migration from legacy systems to AWS data lakes/warehouses.
• Develop and enforce data quality, security, and governance standards.
• Drive DevOps, CI/CD, and infrastructure-as-code practices within the team.
• Ensure cost-effectiveness and performance; stay current with AWS advancements.

Conoscenze

Data engineering

Leadership

ETL/ELT

Data lakes/Warehouses

CI/CD

Formazione

Bachelor's or Master's in CS/Engineering

Strumenti

Glue

Redshift

S3

Lambda

EMR

Kinesis

Athena

RDS

API Gateway

CloudFormation

Terraform

Descrizione del lavoro

Cloud Analytics Technologies, LLC seeks an experienced AWS Data Engineer to join the Data Engineering team in Newark. You will implement and manage scalable data solutions on AWS, mentor engineers, and collaborate with cross-functional partners to ensure best practices in cloud data engineering.

You will design end-to-end data pipelines, oversee data migration to data lakes and warehouses, and lead efforts in data quality, security, and governance while adopting DevOps and IaC practices.