Engineering Manager - AWS & PySpark | Data & Tech Lead

Testing Site - JPMC; Columbus (OH); On-site; USD 140,000 - 210,000; Full time

Job summary

JPMorganChase is seeking a Manager of Software Engineering in Columbus, OH, within Consumer and Community Banking - Data and Technology. You will lead multiple teams, guide daily engineering tasks, and ensure compliance with business requirements and best practices.

The role emphasizes building scalable ETL/ELT pipelines, coordinating cross-team dependencies, and maintaining strong stakeholder relations to deliver data-driven products.

Qualifications

• Strong python development experience, including modular coding, logging, and testing.
• Familiarity with PySpark or distributed data processing frameworks.
• Experience structuring multi-environment projects (dev/uat/prod).
• Proficiency in writing DBT macros, jinja templates, seeds, and custom test cases.
• Ability to build and manage parameterized DAGs and manage task dependencies.
• Experience with Airflow.
• Proficiency with Glue jobs, Athena, CloudWatch, and Lambda.
• Working knowledge of Terraform for infrastructure automation.
• Understanding of Iceberg, Delta Lake and data-lake architectures.
• Designing and optimizing ETL/ELT pipelines.
• Experience with version control like GIT, testing frameworks, and code reviews.

Responsibilities

• Provides guidance to immediate team of software engineers on daily tasks and activities
• Sets the overall guidance and expectations for team output, practices, and collaboration
• Anticipates dependencies with other teams to deliver products and applications in line with business requirements
• Manages stakeholder relationships and the team’s work in accordance with compliance standards, service level agreements, and business requirements
• Creates a culture of diversity, opportunity, inclusion, and respect for the team members and prioritizes diverse representation

Skills

Python

PySpark

Airflow

DBT macros

SQL

ETL/ELT design

Terraform

GIT

Data governance

Iceberg/Delta Lake

Docker

Lambda

Athena

CloudWatch

Tools

Airflow

Glue

Terraform

Snowflake

Kubernetes

Docker

Job description

JPMorganChase is seeking a Manager of Software Engineering in Columbus, OH, within Consumer and Community Banking - Data and Technology. You will lead multiple teams, guide daily engineering tasks, and ensure compliance with business requirements and best practices.

The role emphasizes building scalable ETL/ELT pipelines, coordinating cross-team dependencies, and maintaining strong stakeholder relations to deliver data-driven products.