AWS Data Engineer

MACHINE LEARNING TECHNOLOGIES LLC; Newark (NJ); Sur place; USD 98 000 - 131 000; Plein temps

Résumé du poste

MACHINE LEARNING TECHNOLOGIES LLC is seeking an experienced AWS Lead Data Engineer to join our Data Engineering team in Newark, NJ. You will architect, implement, and manage scalable data solutions on AWS, mentor engineers, and collaborate with data scientists and stakeholders to deliver end-to-end data platforms.

Responsibilities include building data pipelines, data lakes and warehouses, enforcing data quality and security standards, and driving DevOps and IaC practices.

Qualifications

• Bachelor’s or master’s degree in CS, Engineering, or related field.
• 7+ years in data engineering, with ≥3 in leadership roles.
• Extensive hands-on AWS data services expertise (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS).
• Proficient in Python and SQL; Shell scripting and Scala a plus.
• Experience in designing data lakes and warehouses on AWS.
• Strong ETL/ELT, data modeling, and big data frameworks.
• Proven ability to lead and mentor engineers.
• Experience with DevOps, CI/CD, IaC (CloudFormation, Terraform).
• Excellent problem-solving and communication skills.

Responsabilités

• Lead design and optimization of data pipelines and lake architecture on AWS.
• Architect end-to-end data solutions: ingestion, storage, transformation, analytics on AWS.
• Mentor and review code; enforce best practices in data engineering.
• Collaborate with data scientists, analysts and stakeholders to translate requirements.
• Oversee migration from legacy systems to AWS data lakes and warehouses.
• Develop and enforce data quality, security, and governance standards.
• Drive DevOps, CI/CD, and IaC within the data engineering team.
• Ensure cost-effective, performant solutions aligned with enterprise strategy.
• Stay current with AWS trends and evaluate new tools for adoption.
• Troubleshoot complex data issues and provide technical leadership.

Connaissances

Data engineering leadership

AWS data services

Python

SQL

ETL/ELT design

CI/CD

Data lake architecture

Big data frameworks

IaC (CloudFormation/Terraform)

Data governance

Formation

Bachelor's or Master's in CS/Engineering

Outils

AWS Glue

Amazon Redshift

Amazon S3

AWS Lambda

EMR/Spark

Kinesis

Athena

RDS

API Gateway

CloudFormation

Terraform

Description du poste

Job Description

We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting, implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering. Candidate would be required to work from NJ office as part of this role.

Job Overview

• Job ID: J54446
• Job Title: AWS Data Engineer
• Location: Newark, NJ
• Duration: 12 Months + Extension
• Domain Exposure: Banking & Finance
• Client: To Be Discussed Later
• Employment Type: W-2, 1099, C2C
• Work Authorization: US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other
• Bill Rate: $83/hour (C2C)
• Job Type: W-2, 1099, C2C
• Client: To Be Discussed Later
• Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Key Responsibilities

• Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
• Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
• Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
• Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
• Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
• Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
• Troubleshoot complex data issues and provide technical leadership in problem resolution.

Required Qualifications

• Bachelor’s or master’s degree in computer science, Engineering, or a related field.
• 7+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer roles.
• Extensive hands‑on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
• Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
• Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
• Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
• Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
• Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
• Excellent problem-solving, communication, and organizational skills.

Preferred Qualifications

• Experience with real‑time streaming technologies.
• Knowledge of data governance, compliance, and security best practices.
• Familiarity with Lakehouse architecture and modern data platforms.

Equal Opportunity Employer

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.