AI-Driven ETL Lead Engineer (Java & Spark)

JPMorgan Chase & Co.; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Lead Software Engineer in the Consumer & Community Banking Marketing Technology team to advance trusted, scalable technology products.

You will lead architecture and hands-on delivery of large-scale data pipelines, build data lake patterns, and drive secure, high-quality software with Java and Python. The role emphasizes AI-assisted development, SDLC tooling, and cross-functional collaboration to deliver impactful data-enabled solutions within a regulated

Qualifications

• Formal training or certification in software engineering with 5+ years of applied experience.
• Proven experience with AI-assisted software development tools and secure outputs.
• Strong data engineering and big data platform expertise.
• 10 years of software engineering experience with data engineering focus.
• Proficiency in Java and at least one data-focused language like Python.
• Proven experience designing and building robust ETL/ELT pipelines and data integration frameworks.
• Strong experience with Apache Spark and distributed processing concepts.
• Solid knowledge of data lake/lakehouse patterns and data governance.
• Experience with Snowflake or equivalent cloud data warehouses.
• Ability to lead technical discussions across cross-functional teams.

Responsibilities

• Executes creative software solutions and troubleshoot complex problems.
• Leads AI-assisted engineering practices to improve quality, speed, and reliability.
• Uses SDLC tools to improve automation and value realization.
• Leads architecture and delivery of large-scale data pipelines (ETL/ELT).
• Designs data lake patterns with governance and reusable data products.
• Builds and optimizes Spark-based workloads and formats (Parquet/Avro).
• Tunes performance across compute and storage (shuffle, joins, caching).
• Implements code quality, testing, CI/CD, observability, and secure coding.
• Develops Java services for data workflows and APIs.
• Creates REST APIs and integration components for platform interoperability.
• Applies clean architecture and SOLID principles in delivery.

Skills

Java

Python

Spark

Data pipelines

CI/CD

APIs

Data modeling

Security by design

Tools

Airflow

Snowflake

Kafka

Delta Lake

Dagster

Job description

JPMorgan Chase & Co. is seeking a Lead Software Engineer in the Consumer & Community Banking Marketing Technology team to advance trusted, scalable technology products.

You will lead architecture and hands-on delivery of large-scale data pipelines, build data lake patterns, and drive secure, high-quality software with Java and Python. The role emphasizes AI-assisted development, SDLC tooling, and cross-functional collaboration to deliver impactful data-enabled solutions within a regulated