AI-Driven Lead Data Engineer - Python & Big Data

JPMorgan Chase & Co.

Jersey City (NJ)

On-site

USD 170,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

JPMorgan Chase & Co. in Jersey City seeks a Lead Software Engineer to shape AI‑first analytics and data products within Global Prime Brokerage. You will lead an agile team, drive modernization of the data mesh, and build scalable, governed data platforms using Python, PySpark, and Java.

You will deliver secure, reliable analytics solutions across business functions while advancing AI capabilities and ecosystem integration.

Qualifications

  • Formal training or certification on software engineering concepts and 5+ years applied experience.
  • Proven leadership delivering AI-first analytics and data engineering at scale.
  • Experience developing data ingestion and integration processes for analytics-ready datasets.
  • Deep hands-on experience with big data platforms (Spark, Databricks, Snowflake, Iceberg).
  • Strong programming in Python and PySpark, or Java, with CI/CD and containerization practices.
  • Applied AI expertise in ML pipelines, NLP/LLMs, and autonomous agents.
  • Governance across lineage, data quality, and access control with regulatory alignment.
  • Comfortable in an agile environment with strong communication.
  • Proficient in SDLC tools and AI-assisted development.

Responsibilities

  • Collaborate with business and technology teams to develop AI‑first analytics and data product solutions.
  • Define and enforce architecture for an AI‑driven data product lifecycle: semantic extraction/alignment, automated lineage and DQ, pipeline code generation, mesh registration, and self‑service consumption.
  • Build and operate autonomous agents for data engineering that detect schema drift, propose transformations, reconcile semantics, triage data incidents, and maintain governance evidence under human‑in‑the‑loop controls.
  • Design analytics platforms capable of running reporting and other analytics; explore innovative ideas by building real‑time and batch analytics solutions.
  • Establish monitoring and alerting of solution events related to performance, scalability, availability, and reliability.
  • Provide technical leadership, guidance, and direction to other team members; build prototypes for demonstrations for peer groups, business partners, and senior leaders.
  • Drive team adoption of enterprise‑authorized AI‑assisted engineering practices to improve code quality, delivery speed, and operational outcomes.
  • Apply knowledge of SDLC tools to improve automation and value of AI outputs.
  • Lead migration and modernization from legacy stacks to the strategic mesh ecosystem (Databricks/Iceberg/common services).
  • Industrialize entity resolution with ML/LLM solutions and standardize analytical product packaging for reuse and monetization.
  • Embed governance, lineage, and DQ by design across critical domains and regulatory reporting.

Skills

Leadership
AI-first analytics
Python
PySpark
Java
Big data
Data governance
CI/CD
Secure coding
Agile
Communication
ML/LLMs

Tools

Spark
Databricks
Snowflake
Iceberg
Kubernetes
Docker

Job description

JPMorgan Chase & Co. in Jersey City seeks a Lead Software Engineer to shape AI‑first analytics and data products within Global Prime Brokerage. You will lead an agile team, drive modernization of the data mesh, and build scalable, governed data platforms using Python, PySpark, and Java.

You will deliver secure, reliable analytics solutions across business functions while advancing AI capabilities and ecosystem integration.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Lead Software Engineer: Java/Python + AI-Driven Systems
Senior Lead Software Engineer: Java/Python + AI-Driven Systems

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 120,000 - 190,000
Lead AI/ML Data Engineer - AWS, Python/Java
Lead AI/ML Data Engineer - AWS, Python/Java

Aumni • Jersey City (NJ)

On-site
USD 150,000 - 210,000
Lead Python Data Engineer - AI-Driven Cloud & Spark
Lead Python Data Engineer - AI-Driven Cloud & Spark

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 120,000 - 150,000
Lead Data Engineer, AI-First Analytics & Data Mesh
Lead Data Engineer, AI-First Analytics & Data Mesh

JP Morgan Chase • Jersey City (NJ)

On-site
USD 150,000 - 210,000
Lead Data Engineer (AWS, Python, SQL) | AI-Driven Dev
Lead Data Engineer (AWS, Python, SQL) | AI-Driven Dev

JPMorgan Chase • Houston (TX)

On-site
USD 150,000 - 230,000
Lead Python & Data Platform Engineer | AWS, Big Data, AI
Lead Python & Data Platform Engineer | AWS, Big Data, AI

Testing Site - JPMC • Jersey City (NJ)

On-site
USD 170,000 - 250,000
AI-Driven Lead Software Engineer - Cloud & Data
AI-Driven Lead Software Engineer - Cloud & Data

JPMorgan Chase & Co. • Jersey City (NJ)

On-site
USD 150,000 - 230,000
Lead Data Engineer: AI-Driven Data Platform & Cloud
Lead Data Engineer: AI-Driven Data Platform & Cloud

JP Morgan Chase • Jersey City (NJ)

On-site
USD 130,000 - 170,000
Health care coverage
Retirement plan
Backup childcare
+3
AI-Driven Data Analytics Tech Lead
AI-Driven Data Analytics Tech Lead

Aumni • Jersey City (NJ)

On-site
USD 150,000 - 210,000
Comprehensive health care coverage
Retirement savings plan
Tuition reimbursement
+2
Lead Data Engineer - AWS/Python/SQL | AI-Driven Cloud
Lead Data Engineer - AWS/Python/SQL | AI-Driven Cloud

JPMorgan Chase & Co. • Houston (TX)

On-site
USD 180,000 - 240,000