AWS Lead Data Engineer

TechDigital Group; Newark (NJ); Hybrid; USD 120,000 - 150,000; Full time

Job summary

TechDigital Group is seeking an experienced AWS Lead Data Engineer to join our Data Engineering team in Newark, NJ. As a technical leader, you will architect and manage scalable data solutions on AWS, collaborate across teams, and mentor data engineers.

The ideal candidate has 7+ years of relevant experience in data engineering and a strong command of AWS services. This position offers a hybrid work model and the opportunity to lead innovative data projects.

Qualifications

• 7 to 10 years of experience in data engineering, with at least 3 years in a lead role.
• Extensive hands-on experience with AWS data services.
• Strong experience in designing and managing data lakes and warehouses.

Responsibilities

• Lead the design and optimization of data pipelines on AWS.
• Mentor and guide a team of data engineers.
• Architect end-to-end data solutions using AWS services.

Skills

AWS Lambda

AWS RDS

AWS EMR

AWS Glue

Redshift

AWS Athena

AWS Kinesis

Python

SQL

Shell scripting

Scala

Education

7+ years of experience in data engineering

AWS Solutions Architect or AWS Data Engineer certification

Tools

CloudFormation

Terraform

Job description

Job Summary

We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting, implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross‑functional partners, and ensure best practices in cloud data engineering. Candidate would be required to work from NJ office as part of this role.

Experience

7 to 10 years

Required Skills

• AWS Lambda
• AWS RDS
• AWS EMR
• AWS Glue
• Redshift
• AWS Athena
• AWS Kinesis

Shift

Day

Responsibilities

1. Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
2. Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services – Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.
3. Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture.
4. Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
5. Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
6. Develop and enforce standards for data quality, security, and governance.
7. Drive the adoption of DevOps, CI or CD, and infrastructure-as-code practices within the data engineering team.
8. Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
9. Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
10. Troubleshoot complex data issues and provide technical leadership in problem resolution.

Qualifications

1. 7+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer role.
2. Extensive hands‑on experience with AWS data services – Glue, Redshift, S3, Lambda, EMR or Spark, Kinesis, Athena, RDS, API Gateway, etc.
3. Proficient in programming languages such as Python and SQL, experience with Shell scripting and Scala is a plus.
4. Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
5. Proven experience with ETL or ELT processes, data modeling, and big data frameworks.
6. Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
7. Experience with DevOps practices, CI or CD pipelines, and infrastructure-as-code tools e.g., CloudFormation, Terraform.
8. Excellent problem-solving, communication, and organizational skills.

Location

Primary: USNJNEAC01 Newark - NJ USA

Job Type

Business Associate (50CW00)

Travel Requirements

None

Certifications

1. AWS Solutions Architect or AWS Data Engineer certification.
2. Experience with real-time streaming technologies.
3. Knowledge of data governance, compliance, and security best practices.

Work Model

Hybrid

Subcontractor Allowed

Yes