Senior AWS Data Engineer - Lead Data Lake & Pipelines

Quantum Technologies. LLC; Newark (NJ); On-site; USD 140,000 - 170,000; Full time

Job summary

Quantum Technologies. LLC is seeking an experienced AWS Data Engineer to join our Data Engineering team. You will implement and manage scalable data solutions on AWS, mentor engineers, and collaborate with cross-functional partners to ensure best practices in cloud data engineering.

You will design and optimize data pipelines, migrate legacy data to AWS data lakes and warehouses, and enforce data quality, security, and governance while driving DevOps adoption and IaC practices.

Qualifications

• Bachelor’s or Master’s degree in computer science, engineering, or a related field.
• 6+ years of data engineering experience with at least 3 years in technical leadership or lead engineer role.
• Hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, etc.).
• Proficient in Python and SQL; Shell scripting and Scala a plus.
• Experience with data lakes, data warehouses, ETL/ELT, and big data frameworks.
• Leadership, mentoring, and coaching of engineers; collaboration with cross-functional teams.
• DevOps, CI/CD, infrastructure-as-code tools (CloudFormation, Terraform).
• Strong problem-solving and communication skills.

Responsibilities

• Lead the design, development, and optimization of large-scale data pipelines and data lake architecture on AWS.
• Architect end-to-end data solutions including ingestion, storage, transformation, and analytics with AWS services.
• Mentor and guide a team of data engineers; perform code reviews and promote best practices.
• Collaborate with data scientists, analysts, and stakeholders to translate requirements into scalable solutions.
• Oversee migration of data from legacy systems to AWS data lakes and warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Advance DevOps practices, CI/CD, and infrastructure-as-code within the team.
• Stay current with AWS data tech and evaluate new tools for adoption.
• Troubleshoot complex data issues and provide technical leadership in resolution.

Skills

AWS data services

Python

SQL

Leadership

Data pipelines

ETL/ELT

CI/CD

DevOps

Education

Bachelor’s or Master’s degree in Computer Science or Engineering

Tools

Terraform

CloudFormation

Job description

Quantum Technologies. LLC is seeking an experienced AWS Data Engineer to join our Data Engineering team. You will implement and manage scalable data solutions on AWS, mentor engineers, and collaborate with cross-functional partners to ensure best practices in cloud data engineering.

You will design and optimize data pipelines, migrate legacy data to AWS data lakes and warehouses, and enforce data quality, security, and governance while driving DevOps adoption and IaC practices.