AWS Data Engineer

CloudBigD

Newark (NJ)

On-site

USD 140,000 - 190,000

Full time

4 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CloudBigD in Newark, NJ seeks an experienced AWS Lead Data Engineer to architect, implement, and manage scalable data solutions on AWS. You will guide a team of data engineers, mentor, and collaborate with data scientists and business stakeholders to deliver secure, cost-effective data pipelines.

The role requires delivering end-to-end data lake/warehouse solutions, ensuring data quality and governance while advancing DevOps practices and cloud-native architecture.

Qualifications

  • 7+ years in data engineering with ≥3 years in leadership roles
  • Hands-on AWS data services experience
  • Proficient in Python and SQL; shell scripting and Scala a plus
  • Strong experience designing data lakes and data warehouses on AWS
  • Experience leading, mentoring, and coaching engineers
  • Experience with DevOps, CI/CD, and infrastructure-as-code tools (CloudFormation, Terraform)
  • Excellent problem-solving, communication, and organizational skills

Responsibilities

  • Lead design, development, and optimization of large-scale data pipelines and data lake architecture on AWS
  • Architect end-to-end data solutions including ingestion, storage, transformation, and analytics using AWS services
  • Mentor data engineers and conduct code reviews to enforce best practices
  • Collaborate with data scientists, analysts, and stakeholders to translate requirements into scalable solutions
  • Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses
  • Develop and enforce data quality, security, and governance standards
  • Promote DevOps, CI/CD, and infrastructure-as-code practices within the team
  • Ensure cost-effective, performant solutions aligned with enterprise data strategy
  • Stay updated with AWS advancements and evaluate new tools for potential adoption
  • Troubleshoot complex data issues and provide technical leadership

Skills

Python
SQL
Shell scripting
Scala
Technical leadership

Education

Bachelor’s or Master’s degree in CS/Engineering

Tools

AWS Glue
Amazon Redshift
Amazon S3
AWS Lambda
EMR/Spark
Kinesis
Athena
Amazon RDS
API Gateway
CloudFormation
Terraform

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:
We are seeking an experienced AWS Lead Data Engineer to join our Data Engineering team. As a technical leader, you will be responsible for architecting, implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering. Candidate would be required to work from NJ office as part of this role.

Key Responsibilities:

  • Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
  • Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
  • Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture.
  • Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
  • Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
  • Develop and enforce standards for data quality, security, and governance.
  • Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
  • Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
  • Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
  • Troubleshoot complex data issues and provide technical leadership in problem resolution.

Required Qualifications:

  • Bachelor’s or master’s degree in computer science, Engineering, or a related field.
  • 7+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer roles.
  • Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
  • Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
  • Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
  • Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
  • Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
  • Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
  • Excellent problem-solving, communication, and organizational skills.

Preferred Qualifications:

  • Experience with real-time streaming technologies.
  • Knowledge of data governance, compliance, and security best practices.
  • Familiarity with Lakehouse architecture and modern data platforms.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AWS Data Engineer
AWS Data Engineer

Quantum Technologies. LLC • Newark (NJ)

On-site
USD 150,000 - 190,000
AWS Data Engineer
AWS Data Engineer

Robotic Technologies Automation • Newark (NJ)

On-site
USD 140,000 - 190,000
AWS Data Engineer
AWS Data Engineer

Ethereum Technologies • Newark (NJ)

On-site
USD 140,000 - 210,000
AWS Data Engineer
AWS Data Engineer

Quantum Technologies LLC • Newark (NJ)

On-site
USD 140,000 - 170,000
AWS Data Engineer
AWS Data Engineer

Ethereum Technologies LLC • Newark (NJ)

On-site
USD 140,000 - 200,000
AWS Data Engineer
AWS Data Engineer

Valiant Technologies LLC • Newark (NJ)

On-site
USD 140,000 - 180,000
AWS Data Engineer
AWS Data Engineer

Quantum Technologies LLC • Chicago (IL)

On-site
USD 120,000 - 170,000
AWS Data Engineer
AWS Data Engineer

Ethereum Technologies LLC • New Jersey

On-site
USD 120,000 - 180,000
AWS Data Engineer
AWS Data Engineer

Valiant Technologies LLC • Dallas (TX)

On-site
USD 77,000 - 110,000
AWS Data Engineer
AWS Data Engineer

Quantum Technologies LLC • Dallas (TX)

On-site
USD 77,000 - 110,000