Lead Data Engineer - AI-Driven ETL & Spark Architect

JPMorgan Chase & Co.; Columbus (OH); On-site; USD 130,000 - 180,000; Full time

Job summary

JPMorgan Chase & Co. in Columbus, OH, seeks a Lead Data Engineer with deep expertise in ETL/ELT pipelines, Java, and AI-assisted software development. You will architect and deliver large-scale data pipelines, design data lake patterns, and drive modern engineering practices across cross-functional teams.

The role emphasizes Spark, Parquet/Avro formats, and cloud data warehousing with Snowflake. You will mentor engineers, implement secure coding, and shape data governance within a fast-paced

Qualifications

• Formal software engineering training with 5+ years of applied experience.
• Demonstrated leadership in using AI-assisted development tools with clear quality controls.
• Strong understanding of responsible AI, security, and resiliency in delivery practices.
• 10+ years of software engineering experience with a focus on data engineering.

Responsibilities

• Executes creative software solutions and technical troubleshooting beyond routine approaches.
• Drives adoption of enterprise AI-assisted engineering practices to improve quality and speed.
• Applies SDLC tools to enhance automation value across delivery.
• Lead architecture and hands-on delivery of large-scale ETL/ELT data pipelines.
• Design data lake patterns with quality, lineage, and governance.
• Build and optimize Spark-based workloads and storage formats.
• Tune performance for compute and storage (Spark, warehouse).
• Implement engineering best practices: CI/CD, observability, security-by-design.
• Build Java-based services for data workflows and REST APIs.
• Develop APIs and integration components for platform interoperability.
• Apply modern engineering practices: clean architecture and test automation.

Skills

Java

Python

ETL/ELT

Apache Spark

Data pipelines

AI-assisted development

Tools

Airflow

Dagster

Control-M

Snowflake

Job description

JPMorgan Chase & Co. in Columbus, OH, seeks a Lead Data Engineer with deep expertise in ETL/ELT pipelines, Java, and AI-assisted software development. You will architect and deliver large-scale data pipelines, design data lake patterns, and drive modern engineering practices across cross-functional teams.

The role emphasizes Spark, Parquet/Avro formats, and cloud data warehousing with Snowflake. You will mentor engineers, implement secure coding, and shape data governance within a fast-paced