Lead-AWS Data Engineer

Iris Software Inc.; Newark (NJ); Hybrid; USD 160,000 - 260,000; Full time

Job summary

Iris Software Inc. is seeking a Lead AWS Data Engineer in Newark, NJ, with 15+ years of experience. The role is hybrid (Tue/Wed/Thu on-site) and focuses on building and governing data lake/warehouse solutions on AWS, with multi-service orchestration and CI/CD for data platforms.

Responsibilities include designing end-to-end data pipelines, migrating data to AWS data stores, and implementing high-velocity streaming solutions using Kinesis, SQS, and Kafka where appropriate.

Qualifications

• Bachelor's degree in computer science, software eng, MIS or equivalent
• Experience implementing data lakes, data warehouses and data apps on AWS
• Python, Shell scripting and SQL proficiency
• Strong AWS services experience: CloudFormation, S3, Glue, EMR/Spark, Redshift
• End-to-end data solutions on AWS: ingest, storage, processing, access
• Knowledge of CI/CD for data platforms

Skills

AWS Data Eng

Data Lakes/Warehouses

Python

SQL

ETL/ELT

CI/CD for data

Education

Bachelor's degree in CS/SE/MIS or equivalent

Tools

CloudFormation

S3

Athena

Glue

EMR/Spark

RDS

Redshift

DynamoDB

Lambda

Step Functions

IAM

KMS

API Gateway

Elasticsearch

Kinesis

Kafka

Job description

Iris client, one of their Financial Client is looking to hire Lead AWS Data Engineer for Newark NJ (Hybrid)

Job Title: Lead AWS Data Engineer

Location: Newark NJ (Hybrid-Tue, Wed, Thus)

Experience: 15+ years

Experience:

• Bachelor's degree in computer science, Software Engineering, MIS or equivalent combination of education and experience


• Experience implementing, supporting data lakes, data warehouses and data applications on AWS for large enterprises


• Programming experience with Python, Shell scripting and SQL


• Solid experience of AWS services such as CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, SM etc.


• Solid experience implementing solutions on AWS based data lakes.


• Should have good experience with AWS Services - API Gateway, Lambda, Step Functions, SQS, DynamoDB, S3, Elasticsearch


• Experience in AWS data lake/data warehouse/business analytics


• Experience in system analysis, design, development, and implementation of data ingestion pipeline in AWS


• Knowledge of ETL/ELT


• End-to-end data solutions (ingest, storage, integration, processing, access) on AWS


• Architect and implement CI/CD strategy for EDP


• Implement high velocity streaming solutions using Amazon Kinesis, SQS, and Kafka (preferred)


• Migrate data from traditional relational database systems, file systems, NAS shares to AWS relational databases such as Amazon RDS, Aurora, and Redshift


• Migrate data from APIs to AWS data lake (S3) and relational databases such as Amazon RDS, Aurora, and Redshift


• Implement POCs on any new technology or tools to be implemented on EDP and onboard for real use-case


• AWS Solutions Architect or AWS Developer Certification preferred


• Good understanding of Lakehouse/data cloud architecture