Senior Data Platform Engineer: Scale Pipelines & Governance

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 140,000 - 210,000; Full time

Job summary

JPMorgan Chase & Co. invites applications for a Lead Software Engineer role in the Commercial & Investment Banking – Data Analytics – Payments Technology team. You will be a core technical contributor delivering trusted, scalable data products in a secure environment.

You will design and build data pipelines using Spark, Airflow, Kafka, and Flink, mentor engineers, and partner with product managers to translate data needs into production-grade solutions.

Qualifications

• 5+ years of applied software engineering or data platform development experience.
• Hands-on experience delivering system design, application development, testing, and operational stability.
• Demonstrated professional experience focused on software engineering or data platform development.
• Advanced in one or more programming languages (Python, Java and SQL).
• Hands-on experience with distributed data processing frameworks such as Apache Spark and Flink.
• Solid understanding of data modeling techniques (star schema, snowflake) and query optimization.
• Experience designing and operating data pipelines on Databricks using orchestration tools such as Apache Airflow.
• Proficiency with cloud data services (AWS S3, Glue, Redshift, Athena, EMR, Lake Formation, or equivalent).
• Experience engineering production-grade data platforms on Kubernetes with open catalog integration (e.g., Apache Iceberg, Unity Catalog, OpenMetadata).
• Advanced understanding of agile methodologies such as CI/CD, Application Resiliency, and Security.

Responsibilities

• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems
• Designs, builds, and maintains scalable data pipelines and ETL/ELT workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink
• Develops data platform components including data cataloging, data quality frameworks, and semantic/metrics layers with embedded governance, lineage, and compliance standards
• Implements data modeling strategies (fact and dimensional, wide tables) to support analytics, reporting, and downstream consumption
• Partners with analytics teams, product managers, and business stakeholders to translate data requirements into production-grade solutions
• Develops secure high-quality production code, and reviews and debugs code written by others
• Identifies opportunities to eliminate or automate remediation of recurring issues to improve overall operational stability of software applications and systems
• Leads evaluation sessions with external vendors, startups, and internal teams to drive outcomes-oriented probing of architectural designs, technical credentials, and applicability for use within existing systems and information architecture
• Leads communities of practice across Software Engineering to drive awareness and use of new and leading-edge technologies
• Adds to team culture of diversity, opportunity, inclusion, and respect

Skills

Python

Java

SQL

CI/CD

Agile

Education

Formal training or certification in software engineering

Tools

Spark

Flink

Airflow

Databricks

Kubernetes

Iceberg

OpenMetadata

Terraform

Job description

JPMorgan Chase & Co. invites applications for a Lead Software Engineer role in the Commercial & Investment Banking – Data Analytics – Payments Technology team. You will be a core technical contributor delivering trusted, scalable data products in a secure environment.

You will design and build data pipelines using Spark, Airflow, Kafka, and Flink, mentor engineers, and partner with product managers to translate data needs into production-grade solutions.