Senior Data Engineering Lead: Spark, AWS & Lakehouse

JPMorgan Chase & Co.; Columbus (OH); On-site; USD 120,000 - 160,000; Full time

Job summary

JPMorgan Chase & Co. in Columbus, OH is seeking a Lead Software Engineer – Data Engineering to join the Consumer & Community Banking/Data Products team. You will design and deliver trusted data products in a secure, scalable way and contribute across multiple data platforms.

The role emphasizes ETL pipelines, PySpark, SQL, and cloud services on AWS, with responsibilities including code reviews, CI/CD, and AI-assisted tooling to improve quality and delivery speed.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience with a strong focus on data engineering.
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages – Python (primary) & Java (secondary)
• Hands-on experience with PySpark or other distributed data processing frameworks.
• Strong expertise in DBT (Data Build Tool) and modern ETL development practices.
• Experience with workflow orchestration platforms such as Control-M or Apache Airflow (MWAA).
• Expertise with AWS data services, including Glue, Athena, CloudWatch, and Lambda.
• Knowledge of modern open table formats such as Iceberg and/or Delta Lake.
• Experience with Snowflake administration and development.
• Strong SQL skills and experience with modern database technologies.
• Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes.

Responsibilities

• Design, develop, and optimize large-scale ETL data pipelines.
• Build high-quality Python applications using modular code, logging, and automated testing.
• Develop and maintain distributed data processing solutions using PySpark.
• Large scale end-to-end testing design and validation.
• Implement and support workflow orchestration using Control-M or Apache Airflow (MWAA).
• Develop cloud-native solutions leveraging AWS services, including Glue, Athena, Lambda, and CloudWatch.
• Design and manage modern data lake architectures utilizing Iceberg and/or Delta Lake.
• Administer and optimize Snowflake environments, including streams, tasks, roles, and warehouses.
• Participate in code reviews and champion engineering best practices, testing standards, and CI/CD processes.
• Leverage approved AI-assisted development tools while ensuring secure, responsible, and compliant software delivery.

Skills

Python

Java

SQL

PySpark

Data engineering

CI/CD

Tools

DBT

Snowflake

Airflow

Control-M

Iceberg

Delta Lake

AWS (Glue, Athena, Lambda)

Job description

JPMorgan Chase & Co. in Columbus, OH is seeking a Lead Software Engineer – Data Engineering to join the Consumer & Community Banking/Data Products team. You will design and deliver trusted data products in a secure, scalable way and contribute across multiple data platforms.

The role emphasizes ETL pipelines, PySpark, SQL, and cloud services on AWS, with responsibilities including code reviews, CI/CD, and AI-assisted tooling to improve quality and delivery speed.