Sr Lead Software Engineer - Data Engineering

JPMorgan Chase & Co.; Wilmington (DE); On-site; USD 130,000 - 210,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Senior Lead Software Engineer in data engineering to drive platform design and real-time/batch processing. You will lead by example, writing production-grade code and guiding a Scrum team across complex data utilities.

The role requires deep expertise in Java, Python, Scala, and AWS Databricks, with a focus on data governance, quality, and scalable architectures. Strong AI/ML knowledge is valued.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Strong hands-on programming expertise in Java, Python, and Scala.
• Experience delivering high-throughput real-time systems and large-scale Spark processing.
• Deep hands-on experience with AWS, Databricks, and Snowflake, including Unity Catalog and Delta Lake.
• Experience with Kafka, Cassandra, and NoSQL streaming services.
• Mastery of Agile/Scrum delivery in practice.

Responsibilities

• Design, build, and deliver reusable frameworks and platforms for real-time and batch processing.
• Write production code daily and lead by example on quality and reliability.
• Lead a Scrum team, decompose complex problems, and unblock engineers.
• Mentor engineers, raise code-review standards, grow platform depth.
• Provide recommendations on data governance and data lineage across data lifecycle.
• Leverage AI capabilities to accelerate design, testing, and documentation.
• Deliver data collection, storage, access, and analytics across AWS, Databricks, Snowflake.
• Collaborate with product, modeling, and deployment teams to meet data needs.
• Present designs and metrics to stakeholders with clear visuals.

Skills

Java

Python

Scala

Agile/Scrum

Data engineering

AI/ML

SQL

Tools

AWS

Databricks

Snowflake

Kafka

Cassandra

Job description

Embrace this pivotal role as an essential member of a high-performing team dedicated to reaching new heights in data engineering. Your contributions will be instrumental in shaping the future of one of the world's largest and most influential companies.

As a Senior Lead Software Engineer at JPMorganChase within Consumer & Community Banking Risk Technology, you are an integral part of an agile team that designs, builds, and delivers the data utilities and platforms our modeling, analytics, and risk partners depend on. This is a hands-on engineering role — you lead through technical depth, design authority, and the code you write. You will lead a Scrum team building cutting-edge data utilities, setting the technical direction and raising the engineering bar for everyone around you. Leverage your deep technical expertise and problem-solving capabilities to drive significant business impact and tackle a diverse array of challenges spanning real-time and batch data platforms, multiple data architectures, and a wide range of data consumers.

Job responsibilities

• Design, build, and deliver reusable frameworks and platforms that support both high-throughput real-time applications and large-scale batch processing — including Spark workloads over datasets spanning billions of records — in a secure, stable, and scalable way
• Write production code daily as the senior technical contributor on the team; lead by example on design quality, testing, and operational readiness
• Lead a Scrum team building cutting-edge data utilities, setting technical direction, decomposing complex problems into deliverable work, and unblocking engineers without holding a reporting line
• Build and develop the team's technical capability — mentoring engineers, raising code-review standards, growing depth in the platform stack, and creating the conditions for a self-reliant, high-performing team
• Provide recommendations and insight on data management and governance procedures applicable to the acquisition, maintenance, validation, and utilization of data — spanning Data Governance, Data Quality, Data Profiling, and Data Lineage
• Use the latest enterprise-authorized generative AI and agentic AI capabilities to accelerate design, implementation, testing, and technical documentation — validating outputs and handling data according to sensitivity and security requirements
• Design and deliver trusted data collection, storage, access, and analytics platform solutions across AWS, Databricks, and Snowflake
• Build streaming and low-latency serving components using Kafka, Cassandra, and related AWS services to support real-time consumption
• Partner closely with product, architecture, modeling, and model-deployment teams to understand data requirements and deliver the engineering that feeds and serves them
• Apply reuse-first, AI-assisted practices within delivery and operational routines — ensuring traceability, auditability, and alignment to resiliency and security expectations
• Present technical designs, platform metrics, and data insights to engineering and business stakeholders through clear visual delivery

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience
• Strong hands-on programming expertise in Java, Python, and Scala
• Demonstrated experience building frameworks and platforms — not just applications — that other teams adopt and build on
• Proven experience delivering both high-throughput real-time systems and high-volume Spark processing over very large datasets, with a working command of performance tuning at scale
• Deep hands-on experience with AWS (compute, serverless, managed data services, IAM) and Databricks — including Unity Catalog, Delta Lake, Lakeflow, Delta Live Tables, Catalog Sharing, fine-grained access control, and SQL Warehouses
• Hands-on experience with Snowflake in a production data platform environment
• Working experience with Kafka, Cassandra, and related AWS streaming and NoSQL offerings
• Strong understanding of both relational and NoSQL databases, including data modeling trade-offs between them
• Demonstrated experience using enterprise-authorized generative AI capabilities to accelerate engineering delivery, with strong validation habits and awareness of data sensitivity
• Experience working on AI/ML systems, with a solid understanding of core model families — decision trees, ensemble methods, and neural networks — and a conceptual understanding of transformer models
• Mastery of Agile/Scrum delivery in practice

Preferred qualifications, capabilities, and skills

• Experience mentoring and growing engineers and building team technical capability without formal management authority
• AWS, Databricks, and/or Snowflake certifications
• Strong grasp of Data Governance, Data Quality, Data Profiling, and Data Lineage in regulated environments
• Hands-on experience with feature provisioning for ML — including Feature Store on Unity Catalog
• Experience adopting agentic AI development tooling on a team and measurably accelerating deliver
• Exposure to cloud migration or platform modernization at scale