Senior Data Platform Engineer - Databricks Lakehouse Lead

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 180,000 - 210,000; Full time

Job summary

JPMorgan Chase & Co. in New Jersey is seeking a Lead Software Engineer to drive scalable data platform solutions in Corporate Technology.

You will architect and implement a lakehouse, manage large-scale data ingestion from AWS into Databricks, and champion AI-assisted engineering practices across multi-team delivery. You will mentor engineers, lead design reviews, and ensure secure, compliant data handling while optimizing performance and cost.

Qualifications

• 5+ years of hands-on SDLC experience in software engineering.
• Extensive data engineering leadership for multi-team data platforms.
• Hands-on building and operating a Databricks Lakehouse on AWS.
• Deep Delta Lake expertise including ACID tables and schema evolution.
• Experience with streaming and batch pipelines (Structured Streaming).
• Strong AWS fundamentals: S3, IAM, KMS.
• Experience with AI-assisted development tools and responsible AI practices.
• Reliability ownership: monitoring, incident response, RCA, SLO/SLA.

Responsibilities

• Architect the lake house: design bronze/silver/gold layers and domain data products.
• Deliver ingestion at scale from AWS sources into Databricks (batch + streaming).
• Build maintainable pipelines with Delta Live Tables or modular jobs.
• Operational excellence: productionize workloads with retries, checkpointing, idempotency.
• Governance by design: enforce least privilege, data classification, auditing, lineage.
• Lead adoption of enterprise AI-assisted engineering practices and ensure code quality.
• Apply SDLC tools to improve automation value.
• Performance & cost management: tune Spark/Delta workloads and clusters.
• Lead and mentor: set standards and upskill engineers in Spark/Databricks.
• CI/CD and IaC: Terraform for Databricks + AWS resources; promote across environments.
• Testing: unit/integration tests, data quality checks, version control, runbooks.

Skills

Data engineering

Lakehouse architecture

Databricks

Spark tuning

AWS data services

CI/CD

IaC Terraform

Security & governance

Mentoring

Data governance

Tools

Databricks

Delta Lake

Terraform

AWS (S3/IAM)

CI/CD tooling

Job description

JPMorgan Chase & Co. in New Jersey is seeking a Lead Software Engineer to drive scalable data platform solutions in Corporate Technology.

You will architect and implement a lakehouse, manage large-scale data ingestion from AWS into Databricks, and champion AI-assisted engineering practices across multi-team delivery. You will mentor engineers, lead design reviews, and ensure secure, compliant data handling while optimizing performance and cost.