Senior Data Engineer

JSR Tech Consulting; Newark (NJ); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Major investment firm seeks a Senior AWS Data Engineer to support enterprise data platform initiatives. You will build scalable data pipelines, CI/CD automation, and end-to-end data solutions across the AWS ecosystem. Experience with Informatica, Denodo, and Ataccama is a strong plus.

The role is hybrid with Newark, NJ as the base location, and involves collaborating across teams to deliver data solutions from ingestion to access.

Qualifications

• Bachelor's degree in CS/Software Eng/MIS or equivalent.
• 8+ years as Data Engineer on AWS with DevOps tooling.
• AWS Solutions Architect or AWS Developer Certification required.
• Hands-on with CloudFormation, S3, Athena, Glue, DataBrew, EMR/Spark.
• Experience with RDS, Redshift, DynamoDB, Lambda, Step Functions.
• RBAC using IAM and Redshift RBAC model.
• CI/CD pipelines with CloudFormation and Jenkins.
• Python, Shell, and SQL programming.
• Streaming experience with Kinesis, AWS Managed Airflow, Kafka preferred.

Responsibilities

• Design, build, and maintain efficient, reusable, reliable code.
• Ensure optimal performance of high-scale data applications.
• Participate in system design discussions.
• Hands-on development and unit testing.
• Collaborate to integrate components into the data platform.
• Work cross-functionally across lifecycle stages.
• Identify and resolve performance issues.
• Stay current with emerging technologies and practices.
• Contribute to code reviews and standards compliance.
• Estimate, plan, and manage tasks in Agile environments.
• Take shared responsibility for software quality.
• Collaborate with team members toward common goals.

Skills

8+ years AWS Data Engineer

AWS Certification

Python

Shell scripting

SQL

CI/CD with Jenkins

CloudFormation

Jira

Confluence

Docker

RBAC with IAM/Redshift

Kinesis

Airflow/Kafka

ETL/ELT design

Data ingestion pipelines

REST API data ingestion

Education

Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent

Tools

CloudFormation

S3

Athena

Glue

DataBrew

EMR/Spark

RDS

Redshift

DynamoDB

Lambda

Step Functions

IAM

KMS

EventBridge

EC2

SQS

SNS

Jenkins

Bitbucket

CloudBees

SonarQube

Artifactory

Docker

Jira

Confluence

Job description

Location: Hybrid — 3 days/week onsite in Newark, NJ

About the Role

Join a major investment firm as a Senior AWS Data Engineer supporting enterprise data platform initiatives. This role focuses on building scalable data pipelines, CI/CD automation, and end-to-end data solutions across the AWS ecosystem. Experience with Informatica (data catalogue, marketplace, data lineage, data quality), Denodo, and/or Ataccama is a strong plus.

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, MIS, or equivalent combination of education and experience
• 8+ years of experience as a Data Engineer on the AWS stack, including DevOps tooling
• AWS Solutions Architect or AWS Developer Certification required
• Strong hands-on experience with AWS services, including:
• CloudFormation, S3, Athena, Glue, Glue DataBrew, EMR/Spark
• RDS, Redshift, DynamoDB, Lambda, Step Functions
• IAM, KMS, SM, EventBridge, EC2, SQS, SNS
• Experience implementing high-velocity streaming solutions using Amazon Kinesis, AWS Managed Airflow, and AWS Managed Kafka (preferred)
• Proven experience building AWS data lake/data warehouse solutions
• Skilled in designing, developing, and implementing data ingestion pipelines on AWS
• Knowledge of ETL/ELT implementation for data solutions
• Experience delivering end-to-end data solutions: ingest, storage, integration, processing, and access
• Familiarity implementing RBAC strategies using AWS IAM and Redshift RBAC model
• Experience building and implementing CI/CD pipelines using CloudFormation and Jenkins
• Strong programming skills in Python, Shell scripting, and SQL
• Experience with SQL stored procedures for data analysis
• Experience building automated pipelines to ingest data from relational databases, file systems, and NAS shares into AWS RDS, Aurora, and Redshift
• Experience building automated pipelines to ingest data from REST APIs into AWS S3 and relational databases
• Solid DevOps background, including:
• Bitbucket (source code management)
• API deployment for tooling integration
• Jenkins and CloudBees (Pipeline as Code, Shared Libraries)
• SonarQube, Artifactory, and similar DevOps tools
• Docker
• Jira and Confluence
• Infrastructure as Code via CloudFormation
• Experience creating Jenkins CI pipelines integrating Sonar/security scans and test automation
• Ability to accurately document exceptions, issues, action plans, meeting minutes, and lessons learned

Responsibilities

• Design, build, and maintain efficient, reusable, and reliable code
• Ensure optimal performance and quality of high-scale data applications and services
• Participate in system design discussions
• Independently perform hands-on development and unit testing
• Collaborate with the development team to integrate components into the enterprise data platform
• Work cross-functionally with product, QE/QA, and other teams throughout the full software development lifecycle
• Identify and resolve performance issues
• Stay current with emerging technologies and implementation practices
• Participate in code reviews to ensure standards and best practices are met
• Take ownership of estimating, planning, and managing tasks in an Agile environment
• Take shared responsibility for software quality rather than relying on separate QA teams
• Collaborate closely with all team members toward shared goals
• Engage with users as needed to clarify requirements