AWS Data Engineer

Cloud Analytics Technologies, LLC; Newark (NJ); On-site; USD 140,000 - 190,000; Full time

Job summary

Cloud Analytics Technologies, LLC seeks an experienced AWS Data Engineer to join the Data Engineering team in Newark. You will implement and manage scalable data solutions on AWS, mentor engineers, and collaborate with cross-functional partners to ensure best practices in cloud data engineering.

You will design end-to-end data pipelines, oversee data migration to data lakes and warehouses, and lead efforts in data quality, security, and governance while adopting DevOps and IaC practices.

Qualifications

• Bachelor's or master's degree in computer science, engineering, or related field.
• 6+ years of data engineering experience with at least 3 years in technical leadership.
• Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway).
• Proficient in Python and SQL; Shell scripting and Scala a plus.
• Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
• Proven ETL/ELT, data modeling, and big data frameworks.
• Demonstrated ability to lead, mentor, and coach engineers; DevOps, CI/CD, and Infrastructure-as-Code (CloudFormation, Terraform).
• Excellent problem-solving, communication, and organizational skills.

Responsibilities

• Lead design, development, and optimization of large-scale data pipelines and data lake architecture on AWS.
• Architect end-to-end data solutions including ingestion, storage, transformation, and analytics using AWS services.
• Mentor a team of data engineers and conduct code reviews.
• Collaborate with data scientists, analysts, and stakeholders to translate requirements into scalable solutions.
• Oversee migration from legacy systems to AWS data lakes/warehouses.
• Develop and enforce data quality, security, and governance standards.
• Drive DevOps, CI/CD, and infrastructure-as-code practices within the team.
• Ensure cost-effectiveness and performance; stay current with AWS advancements.

Skills

Data engineering

Leadership

ETL/ELT

Data lakes/Warehouses

CI/CD

Education

Bachelor's or Master's in CS/Engineering

Tools

Glue

Redshift

S3

Lambda

EMR

Kinesis

Athena

RDS

API Gateway

CloudFormation

Terraform

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced AWS Data Engineer to join our Data Engineering team, you will be responsible for implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering.

Key Responsibilities:

• Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
• Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
• Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
• Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
• Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
• Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
• Troubleshoot complex data issues and provide technical leadership in problem resolution.

Required Qualifications:

• Bachelor's or master's degree in computer science, Engineering, or a related field.
• 6+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer role.
• Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
• Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
• Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
• Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
• Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
• Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
• Excellent problem-solving, communication, and organizational skills.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.