Lead Data Engineer — Cloud Pipelines & AI-Driven Tools

Next Frontier Capital; Kentucky; On-site; USD 140,000 - 200,000; Full time

Job summary

JPMorgan Chase is seeking a Lead Software Engineer – Data Engineering to join the Consumer & Community Banking/Data Products team. You will design and deliver trusted, scalable data solutions across multiple business functions, focusing on secure and efficient delivery.

You will lead ETL pipelines, build Python applications, and work with PySpark, Airflow, and AWS to manage modern data lake architectures. Strong collaboration and CI/CD practices are expected.

Qualifications

• 5+ years of applied data engineering experience in a large corporate environment.
• Proficiency in Python (primary) and Java (secondary).
• Strong SQL skills and experience with Snowflake.
• Hands-on with PySpark and distributed data processing.
• Experience with Airflow/Control-M and AWS data services (Glue, Lambda, Athena, CloudWatch).
• Knowledge of Iceberg/Delta Lake and DBT.

Responsibilities

• Design, build, and optimize large-scale ETL data pipelines.
• Develop Python applications with modular, testable code and robust logging.
• Implement and maintain distributed data processing with PySpark.
• Experience with end-to-end testing and CI/CD practices.

Skills

Python

Java

SQL

PySpark

Airflow

AWS

Snowflake

DBT

Iceberg/Delta Lake

Tools

Control-M

MWAA

CI/CD

Job description

JPMorgan Chase is seeking a Lead Software Engineer – Data Engineering to join the Consumer & Community Banking/Data Products team. You will design and deliver trusted, scalable data solutions across multiple business functions, focusing on secure and efficient delivery.

You will lead ETL pipelines, build Python applications, and work with PySpark, Airflow, and AWS to manage modern data lake architectures. Strong collaboration and CI/CD practices are expected.