Lead Data Platform & AI-Driven Analytics Engineer

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorgan Chase & Co. in Jersey City seeks a Lead Software Engineer to drive scalable data pipelines and production-grade software within the Commercial & Investment Banking – Data Analytics – Payments Technology team.

You will design, build, and operate distributed data platforms, collaborate with analytics teams, product managers, and stakeholders, and lead initiatives for governance, security, and efficiency.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years of applied experience.
• Experience delivering system design, application development, testing, and operations.
• Experience in software engineering or data platform development.
• Advanced in Python, Java, and SQL.
• Experience with Spark and Flink for distributed data processing.
• Data modeling knowledge (star/snowflake) and query optimization.
• Experience with Databricks and Airflow for data pipelines.
• Proficiency with cloud data services and Kubernetes.

Responsibilities

• Executes creative software solutions and technical troubleshooting.
• Designs and maintains scalable data pipelines for batch and real-time processing using Spark, Airflow, Kafka, and Flink.
• Develops data platform components with governance, lineage, and compliance standards.
• Implements data modeling strategies to support analytics and reporting.
• Collaborates with analytics teams, product managers, and stakeholders to translate data requirements.
• Develops production-grade code and reviews others' code.
• Identifies and automates remediation of recurring issues to improve stability.
• Leads evaluation sessions with external vendors and teams on architectural designs.
• Leads development of Agentic Autonomous Lakehouse capabilities and data governance initiatives.
• Leads communities of practice across Software Engineering.

Skills

Python

Java

SQL

Apache Spark

Flink

Databricks

Airflow

Kubernetes

CI/CD

Data modeling

Education

Bachelor's degree or equivalent in a related field

Tools

Spark

Airflow

Kafka

Flink

Databricks

Kubernetes

Terraform

Docker

Iceberg

OpenMetadata

Job description

JPMorgan Chase & Co. in Jersey City seeks a Lead Software Engineer to drive scalable data pipelines and production-grade software within the Commercial & Investment Banking – Data Analytics – Payments Technology team.

You will design, build, and operate distributed data platforms, collaborate with analytics teams, product managers, and stakeholders, and lead initiatives for governance, security, and efficiency.