Senior Big Data Engineer - PySpark, Java & AWS

Testing Site - JPMC; Wilmington (DE); On-site; USD 130,000 - 170,000; Full time

Job summary

JPMorgan Chase is seeking an Software Engineer III specializing in Big Data with PySpark, Java, and AWS. You will join a data-centric team that builds scalable pipelines, storage and analytics to enable secure data access for analytics and reporting.

You will contribute to cloud-based data platforms, implement robust data processing, and collaborate within an agile environment to deliver reliable solutions across multiple data domains.

Qualifications

• Formal training or certification in software engineering concepts and 3+ years applied experience.
• Proficient in Java and PySpark, and experience with AWS cloud technologies, including S3.
• Experience with SQL-based technologies (e.g., MySQL/ Oracle DB).
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages.
• AWS Data Services: Lake formation, Glue ETL, S3, Glue Catalog, Athena, Kinesis, Airflow/Lambda + Step Functions + Event Bridge; Data formats: Parquet/Avro/JSON-LD; Data Security concepts: IAM, Encryption, KMS, Secrets Manager.

Responsibilities

• Executes software solutions, design, development, and debugging with the ability to solve complex problems.
• Designs and delivers data collection, storage, access, and analytics data platforms in a secure, scalable way.
• Defines backup, recovery, and archiving strategy.
• Designs and develop data pipelines to ingest, store, and process data from multiple sources.
• Produces production-grade code and maintains algorithms aligned with systems.
• Creates architecture and design artifacts and ensures software meets constraints.
• Gathers and visualizes data for continuous improvement of applications and systems.
• Identifies hidden data patterns to drive coding hygiene and better architecture.
• Contributes to engineering communities of practice and embraces diverse, inclusive culture.

Skills

Java

PySpark

AWS

SQL

CI/CD

Python

Tools

S3

Glue

EMR

Athena

Kinesis

Airflow

Lambda

Step Functions

IAM

KMS

Secrets Manager

Job description

JPMorgan Chase is seeking an Software Engineer III specializing in Big Data with PySpark, Java, and AWS. You will join a data-centric team that builds scalable pipelines, storage and analytics to enable secure data access for analytics and reporting.

You will contribute to cloud-based data platforms, implement robust data processing, and collaborate within an agile environment to deliver reliable solutions across multiple data domains.