AWS Data Engineer

Quantum Technologies. LLC; Newark (NJ); On-site; USD 140,000 - 170,000; Full time

Job summary

Quantum Technologies. LLC is seeking an experienced AWS Data Engineer to join our Data Engineering team. You will implement and manage scalable data solutions on AWS, mentor engineers, and collaborate with cross-functional partners to ensure best practices in cloud data engineering.

You will design and optimize data pipelines, migrate legacy data to AWS data lakes and warehouses, and enforce data quality, security, and governance while driving DevOps adoption and IaC practices.

Qualifications

• Bachelor’s or Master’s degree in computer science, engineering, or a related field.
• 6+ years of data engineering experience with at least 3 years in technical leadership or lead engineer role.
• Hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, etc.).
• Proficient in Python and SQL; Shell scripting and Scala a plus.
• Experience with data lakes, data warehouses, ETL/ELT, and big data frameworks.
• Leadership, mentoring, and coaching of engineers; collaboration with cross-functional teams.
• DevOps, CI/CD, infrastructure-as-code tools (CloudFormation, Terraform).
• Strong problem-solving and communication skills.

Responsibilities

• Lead the design, development, and optimization of large-scale data pipelines and data lake architecture on AWS.
• Architect end-to-end data solutions including ingestion, storage, transformation, and analytics with AWS services.
• Mentor and guide a team of data engineers; perform code reviews and promote best practices.
• Collaborate with data scientists, analysts, and stakeholders to translate requirements into scalable solutions.
• Oversee migration of data from legacy systems to AWS data lakes and warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Advance DevOps practices, CI/CD, and infrastructure-as-code within the team.
• Stay current with AWS data tech and evaluate new tools for adoption.
• Troubleshoot complex data issues and provide technical leadership in resolution.

Skills

AWS data services

Python

SQL

Leadership

Data pipelines

ETL/ELT

CI/CD

DevOps

Education

Bachelor’s or Master’s degree in Computer Science or Engineering

Tools

Terraform

CloudFormation

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced AWS Data Engineer to join our Data Engineering team, you will be responsible for implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering.

Key Responsibilities:

• Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
• Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
• Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
• Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
• Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
• Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
• Troubleshoot complex data issues and provide technical leadership in problem resolution.

Required Qualifications:

• Bachelor’s or master’s degree in computer science, Engineering, or a related field.
• 6+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer role.
• Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
• Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
• Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
• Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
• Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
• Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
• Excellent problem-solving, communication, and organizational skills.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.