AWS Data Engineer - Real-Time Pipelines (Hybrid, Newark)

JSR Tech Consulting; Newark (NJ); Hybrid; USD 90,000 - 110,000; Part time

Job summary

JSR Tech Consulting is seeking a data engineer to design and build scalable batch and real-time data pipelines on AWS for a leading financial firm. The role includes building ETL jobs with PySpark and SQL and ingesting structured and semi-structured data.

The position requires hands-on experience with AWS data services (Glue, Athena, Lambda, Redshift) and a strong understanding of data modeling, security best practices, and CI/CD processes.

Qualifications

• Hands-on experience with AWS Glue, Athena, Lambda and Redshift.
• Strong ETL skills using PySpark and SQL.
• Experience with structured and semi-structured data.
• Awareness of CI/CD processes and AWS security best practices.

Responsibilities

• Design and develop batch and real-time data pipelines on AWS.
• Build ETL jobs using PySpark and SQL.
• Ingest and process structured and semi-structured data.
• Optimize pipelines for cost and performance.
• Apply AWS security best practices to protect data pipelines.

Skills

AWS Glue

AWS Athena

AWS Lambda

AWS Redshift

PySpark

SQL

Structured data

Semi-structured data

CI/CD

AWS data security

Job description

JSR Tech Consulting is seeking a data engineer to design and build scalable batch and real-time data pipelines on AWS for a leading financial firm. The role includes building ETL jobs with PySpark and SQL and ingesting structured and semi-structured data.

The position requires hands-on experience with AWS data services (Glue, Athena, Lambda, Redshift) and a strong understanding of data modeling, security best practices, and CI/CD processes.