AWS Data Engineer

Machine Learning Technologies, LLC; Newark (NJ); On-site; USD 140,000 - 190,000; Full time

Job summary

Machine Learning Technologies, LLC seeks an experienced AWS Data Engineer to design, build, and manage scalable data pipelines and data lake architectures on AWS, guiding a team of engineers and collaborating with data scientists and business partners.

You will drive end-to-end solutions using Glue, Redshift, S3, Lambda, EMR, Kinesis, and Athena, mentor engineers, enforce data quality and governance, and advocate DevOps and IaC practices to optimize cost and performance.

Qualifications

• Bachelor’s or master’s degree in computer science, engineering or a related field.
• 6+ years of data engineering experience, with 3+ years in a technical leadership role.
• Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS).
• Proficient in Python and SQL; Shell scripting and Scala a plus.

Responsibilities

• Lead design, development, and optimization of large-scale data pipelines and data lake architecture on AWS.
• Architect and implement end-to-end data solutions including ingestion, storage, transformation, and analytics using AWS services.
• Mentor and guide a team of data engineers and conduct code reviews.
• Collaborate with data scientists, analysts and business stakeholders to translate requirements into scalable solutions.
• Oversee migration of data from legacy systems to AWS-based data lakes and warehouses.
• Develop and enforce data quality, security, and governance standards.
• Promote DevOps, CI/CD and IaC practices within the team.
• Ensure cost-effectiveness and performance in line with enterprise data strategy.

Skills

Leadership experience

Data engineering

Cloud architecture

Mentoring

Stakeholder communication

Education

Bachelor’s or Master’s in CS/Engineering

Tools

AWS Glue

Amazon Redshift

Amazon S3

AWS Lambda

Amazon EMR

Kinesis

Athena

RDS

Terraform

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced AWS Data Engineer to join our Data Engineering team, you will be responsible for implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering.

Key Responsibilities:

• Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
• Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
• Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
• Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
• Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
• Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
• Troubleshoot complex data issues and provide technical leadership in problem resolution.

Required Qualifications:

• Bachelor’s or master’s degree in computer science, Engineering, or a related field.
• 6+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer role.
• Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
• Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
• Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
• Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
• Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
• Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
• Excellent problem-solving, communication, and organizational skills.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.