Senior Lead Data Platform Engineer: Lakehouse & AWS

Aumni; Jersey City (NJ); On-site; USD 190,000 - 240,000; Full time

Job summary

JPMorganChase is seeking a Senior Lead Software Engineer to architect and deliver an enterprise-scale data platform that enables trusted risk data products in a secure, scalable way. You will guide multi-tenant lakehouse designs, implement secure data pipelines, and mentor engineering teams across Risk and Technology.

You will collaborate with senior leaders, drive modernization, and set technical direction for data governance, AI-assisted practices, and resilient operations within a regulated

Qualifications

• Formal training or certification on software engineering concepts and 5+ years of applied experience.
• Hands-on architecture and delivery of large-scale enterprise data platforms (multi-tenant lakehouse or data mesh).
• Advanced proficiency in Python and/or Java (or Scala) and SQL, with a track record of maintaining production systems in a regulated environment.
• Deep experience with distributed processing and lakehouse technologies: Apache Spark, Databricks (Unity Catalog), and open table formats (Delta Lake and/or Apache Iceberg).
• Experience with data ingestion and integration at scale, including CDC from relational sources, event streaming (Kafka/Kinesis), file/API ingestion, and schema evolution / data contracts.
• Practical cloud-native experience, AWS, plus infrastructure-as-code and CI/CD in a policy-governed environment.
• Strong data governance and security expertise: fine-grained access controls, entitlement/approval workflows, data classification, lineage/data quality, and experience supporting data residency/localization and sensitive data handling obligations.
• Platform reliability and operations: microservices and API design, orchestration tooling, observability, SLO/SLA definition, incident management, and root-cause analysis.
• Proven technical leadership: driving architecture decisions through structured review, influencing senior stakeholders, and mentoring senior engineers and leads.
• Demonstrated experience leading effective use of enterprise-authorized AI-assisted software development tools, with the ability to set expectations for validating AI outputs.
• Strong understanding of responsible AI use in engineering workflows, including secure handling of inputs/outputs and data sensitivity considerations.

Responsibilities

• Owns the technical direction of the platform and lead architecture and design leveraging a Lakehouse on Databricks and AWS, including multi-tenant patterns, cataloging, storage formats (e.g., Delta Lake / Apache Iceberg), and data product publishing.
• Delivers secure, production-grade code for data-intensive systems, including ingestion, transformation, and serving pipelines across batch, streaming, and change data capture (CDC).
• Scales tenant onboarding through self-service by automating onboarding, schema/catalog provisioning, and pipeline orchestration.
• Build infrastructure-as-code and deployment pipelines using Terraform (or equivalent), CI/CD automation, and preventative controls/guardrails aligned to firm policy.
• Makes data governance, entitlements, and data protection integral to the platform design, including least-privilege access controls, approval workflows, and auditability.
• Ensures resilience, observability, and operational excellence by defining SLOs/SLAs, instrumenting services/pipelines (metrics/logs/traces), and leading incident and root-cause analysis in partnership with SRE.
• Acts as a subject-matter expert for risk data engineering and guide teams on architecture trade-offs, data quality, lineage, and reproducibility.
• Leads modernization and technology evaluation, balancing innovation with cost, security, supportability, and operational readiness.
• Drives adoption of enterprise-authorized AI-assisted engineering practices (e.g., code review/refactoring support, test acceleration, troubleshooting support) with clear validation expectations for correctness, performance, and security.
• Influences senior stakeholders across Risk and Technology by aligning roadmaps, prioritizing feature requests, and resolving control findings.
• Builds and lead a high-performing engineering culture through mentoring, strong engineering practices, and a culture of ownership and inclusion.

Skills

Python

Java

Scala

SQL

Spark

Databricks

Unity Catalog

Lakehouse

AWS

CI/CD

Education

Bachelor’s or Master’s in Computer Science or related field

Tools

Terraform

Kubernetes

Delta Lake

Apache Iceberg

Kafka

Kinesis

Job description

JPMorganChase is seeking a Senior Lead Software Engineer to architect and deliver an enterprise-scale data platform that enables trusted risk data products in a secure, scalable way. You will guide multi-tenant lakehouse designs, implement secure data pipelines, and mentor engineering teams across Risk and Technology.

You will collaborate with senior leaders, drive modernization, and set technical direction for data governance, AI-assisted practices, and resilient operations within a regulated