AWS Data Engineer

Valiant Technologies LLC; Newark (NJ); On-site; USD 140,000 - 180,000; Full time

Job summary

Valiant Technologies LLC in Newark, NJ is seeking an experienced AWS Data Engineer to join our Data Engineering team. You will design, build, and operate scalable data pipelines and data lake architectures on AWS, guiding a team of data engineers.

The role emphasizes leadership, collaboration with data scientists and business stakeholders, and adherence to data quality, security, and governance standards.

Qualifications

• 6+ years in data engineering with leadership experience.
• Strong hands-on AWS data services experience.
• Proficient in Python and SQL; Shell scripting a plus.
• Experience with ETL/ELT, data lakes and data warehouses.
• Ability to lead, mentor, and coach engineers in a collaborative team.
• Experience with DevOps practices, CI/CD pipelines and IaC tools.

Responsibilities

• Design and optimize large-scale data pipelines and data lake architecture on AWS.
• Architect end-to-end data solutions for ingestion, storage, transformation, and analytics using AWS services.
• Mentor and guide a team of data engineers and conduct code reviews.
• Collaborate with data scientists, analysts, and stakeholders to translate requirements into scalable solutions.
• Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Drive adoption of DevOps, CI/CD, and infrastructure-as-code practices.
• Ensure cost-effective and performant data solutions aligned with enterprise strategy.
• Stay current with AWS data technologies and evaluate new tools.

Skills

Python

SQL

Shell scripting

Scala

Technical leadership

ETL/ELT

Data modeling

DevOps

CI/CD

Team mentoring

Education

Bachelor’s or Master’s degree in Computer Science or Engineering

Tools

AWS data services (Glue, Redshift, S3)

CloudFormation

Terraform

Git

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced AWS Data Engineer to join our Data Engineering team, you will be responsible for implementing, and managing scalable data solutions on AWS. You will provide technical guidance to a team of data engineers, collaborate with cross-functional partners, and ensure best practices in cloud data engineering.

Key Responsibilities:

• Lead the design, development, and optimization of large-scale, reliable, and secure data pipelines and data lake architecture on AWS.
• Architect and implement end-to-end data solutions, including data ingestion, storage, transformation, and analytics using AWS services (Glue, Redshift, S3, Lambda, EMR, Kinesis, Athena, RDS, etc.).
• Mentor and guide a team of data engineers, conducting code reviews and fostering best practices in data engineering and cloud architecture.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into scalable and maintainable solutions.
• Oversee migration of data from legacy systems to AWS-based data lakes and data warehouses.
• Develop and enforce standards for data quality, security, and governance.
• Drive the adoption of DevOps, CI/CD, and infrastructure-as-code practices within the data engineering team.
• Ensure solutions are cost-effective, performant, and aligned with enterprise data strategy.
• Stay current with advancements in AWS technologies and data engineering trends and evaluate new tools and frameworks for potential adoption.
• Troubleshoot complex data issues and provide technical leadership in problem resolution.

Required Qualifications:

• Bachelor’s or master’s degree in computer science, Engineering, or a related field.
• 6+ years of experience in data engineering, with at least 3 years in technical leadership or lead engineer role.
• Extensive hands-on experience with AWS data services (Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, Athena, RDS, API Gateway, etc.).
• Proficient in programming languages such as Python and SQL; experience with Shell scripting and Scala is a plus.
• Strong experience designing, implementing, and managing data lakes, data warehouses, and data ingestion pipelines on AWS.
• Proven experience with ETL/ELT processes, data modeling, and big data frameworks.
• Demonstrated ability to lead, mentor, and coach engineers in a collaborative team environment.
• Experience with DevOps practices, CI/CD pipelines, and infrastructure-as-code tools (e.g., CloudFormation, Terraform).
• Excellent problem-solving, communication, and organizational skills.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.