Lead AI Data Engineer – Databricks/PySpark

JPMorgan Chase & Co.; Delaware (OH); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorganChase within the Corporate Sector-Global Finance team seeks a Lead Software Engineer focused on Databricks, PySpark, and AI. You will serve as a senior hands-on developer and technical leader, building data infrastructures, retrieval systems, and AI-enabled data products powering enterprise decision-making.

You will mentor junior engineers, drive best practices in secure coding, and collaborate with cross-functional stakeholders to deliver high-impact data solutions in an agile

Qualifications

• 5+ years of hands-on software engineering experience.
• Proven leadership in agile teams and mentoring.
• Expert Python/PySpark development with production code.
• Experience with Databricks and AWS cloud services.
• Strong data engineering, data pipelines, and data governance knowledge.
• Familiarity with CI/CD, testing, and secure coding practices.

Responsibilities

• Build and optimize data pipelines and workflows for agentic AI systems.
• Drive adoption of enterprise AI-assisted engineering practices.
• Develop data retrieval and indexing layers for autonomous search and synthesis.
• Create and maintain tool-use infrastructure—APIs, data services, endpoints.
• Enforce data management, quality, security, and governance standards.
• Hands-on secure production coding and CI/CD deployment; memory and state management for multi-step workflows.
• Review code daily, mentor junior engineers, and raise engineering standards.
• Collaborate with product owners, data scientists, and stakeholders to deliver production-grade AI solutions.

Skills

Python

PySpark

Databricks

AWS

CI/CD

Leadership

Mentoring

Data pipelines

Security best practices

Tools

Databricks

Terraform

Snowflake

Airflow

Job description

JPMorganChase within the Corporate Sector-Global Finance team seeks a Lead Software Engineer focused on Databricks, PySpark, and AI. You will serve as a senior hands-on developer and technical leader, building data infrastructures, retrieval systems, and AI-enabled data products powering enterprise decision-making.

You will mentor junior engineers, drive best practices in secure coding, and collaborate with cross-functional stakeholders to deliver high-impact data solutions in an agile