AWS Data Engineering Lead: Data Lakes & Pipelines

MACHINE LEARNING TECHNOLOGIES LLC; Newark (NJ); On-site; USD 98,000 - 131,000; Full time

Job summary

MACHINE LEARNING TECHNOLOGIES LLC is seeking an experienced AWS Lead Data Engineer to join our Data Engineering team in Newark, NJ. You will architect, implement, and manage scalable data solutions on AWS, mentor engineers, and collaborate with data scientists and stakeholders to deliver end-to-end data platforms.

Responsibilities include building data pipelines, data lakes and warehouses, enforcing data quality and security standards, and driving DevOps and IaC practices.

Qualifications

• Bachelor’s or master’s degree in CS, Engineering, or related field.
• 7+ years in data engineering, with ≥3 in leadership roles.
• Extensive hands-on AWS data services expertise (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS).
• Proficient in Python and SQL; Shell scripting and Scala a plus.
• Experience in designing data lakes and warehouses on AWS.
• Strong ETL/ELT, data modeling, and big data frameworks.
• Proven ability to lead and mentor engineers.
• Experience with DevOps, CI/CD, IaC (CloudFormation, Terraform).
• Excellent problem-solving and communication skills.

Responsibilities

• Lead design and optimization of data pipelines and lake architecture on AWS.
• Architect end-to-end data solutions: ingestion, storage, transformation, analytics on AWS.
• Mentor and review code; enforce best practices in data engineering.
• Collaborate with data scientists, analysts and stakeholders to translate requirements.
• Oversee migration from legacy systems to AWS data lakes and warehouses.
• Develop and enforce data quality, security, and governance standards.
• Drive DevOps, CI/CD, and IaC within the data engineering team.
• Ensure cost-effective, performant solutions aligned with enterprise strategy.
• Stay current with AWS trends and evaluate new tools for adoption.
• Troubleshoot complex data issues and provide technical leadership.

Skills

Data engineering leadership

AWS data services

Python

SQL

ETL/ELT design

CI/CD

Data lake architecture

Big data frameworks

IaC (CloudFormation/Terraform)

Data governance

Education

Bachelor's or Master's in CS/Engineering

Tools

AWS Glue

Amazon Redshift

Amazon S3

AWS Lambda

EMR/Spark

Kinesis

Athena

RDS

API Gateway

CloudFormation

Terraform

Job description

MACHINE LEARNING TECHNOLOGIES LLC is seeking an experienced AWS Lead Data Engineer to join our Data Engineering team in Newark, NJ. You will architect, implement, and manage scalable data solutions on AWS, mentor engineers, and collaborate with data scientists and stakeholders to deliver end-to-end data platforms.

Responsibilities include building data pipelines, data lakes and warehouses, enforcing data quality and security standards, and driving DevOps and IaC practices.