Lead Software Engineer - Data Engineering | Data Technology

Fairygodboss; Columbus (OH); On-site; USD 140,000 - 190,000; Full time

Job summary

JPMorgan Chase is seeking a Lead Software Engineer - Data Engineering to help design and deliver trusted data products at scale within Consumer & Community Banking/Data Products. You will build large-scale ETL pipelines using Python, PySpark, Snowflake, and modern lake formats, while leveraging AWS services and AI-assisted development practices.

The role requires strong SQL, experience with DBT, and expertise in data processing frameworks, with opportunities to mentor engineers in a fast-paced

Qualifications

• Experience with Python (primary) and Java (secondary) in a large corporate environment.
• Hands-on PySpark or distributed data processing experience.
• Strong DBT and modern ETL development practices.
• Experience with workflow orchestration like Control-M or Airflow MWAA.
• Expertise with AWS data services (Glue, Athena, CloudWatch, Lambda).
• Knowledge of Iceberg or Delta Lake open table formats.
• Snowflake administration and development experience.
• Strong SQL and database skills.
• Promotes AI-assisted engineering practices and secure, high-quality code.
• Familiarity with enterprise-SDLC tooling and automation.

Responsibilities

• Design, develop, and optimize large-scale ETL data pipelines.
• Build Python applications with modularity, logging, and tests.
• Develop and maintain distributed data processing with PySpark.
• Design end-to-end tests and validation at scale.
• Implement workflow orchestration with Control-M or Apache Airflow MWAA.
• Develop cloud-native solutions using AWS services (Glue, Athena, Lambda, CloudWatch).
• Design data lake architectures with Iceberg/Delta Lake.
• Administer Snowflake environments (streams, tasks, roles, warehouses).
• Participate in code reviews, CI/CD, and engineering best practices.
• Leverage AI-assisted development tools while ensuring secure, compliant delivery.

Skills

Python

Java

PySpark

SQL

Data engineering

CI/CD

AI-assisted development

Engineering best practices

Education

Formal training or certification in software engineering

Tools

DBT

Control-M

MWAA

Snowflake

Iceberg

Delta Lake

AWS (Glue, Athena, Lambda, CloudWatch)

Airflow

Kafka

Flink

GitHub Copilot

Job description

This is your chance to change the path of your career and work at one of the world's leading financial institutions.

As a Lead Software Engineer - Data Engineering at JPMorgan Chase within the Consumer & Community Banking/Data Products team, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.

Job Responsibilities:

• Design, develop, and optimize large-scale ETL (Extract Transform Load) data pipelines.
• Build high-quality Python applications using modular code, reusable components, logging, and automated testing.
• Develop and maintain distributed data processing solutions using PySpark.
• Large scale end-to-end testing design and validation.
• Implement and support workflow orchestration using Control-M or Apache Airflow (MWAA).
• Develop cloud-native solutions leveraging AWS services, including Glue, Athena, Lambda, and CloudWatch.
• Design and manage modern data lake architectures utilizing Iceberg and/or Delta Lake.
• Administer and optimize Snowflake environments, including streams, tasks, roles, and warehouses.
• Participate in code reviews and champion engineering best practices, testing standards, and CI/CD processes.
• Leverage approved AI-assisted development tools while ensuring secure, responsible, and compliant software delivery.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 5+ years applied experience with a strong focus on data engineering.
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages - Python (primary) & Java (secondary)
• Hands-on experience with PySpark or other distributed data processing frameworks.
• Strong expertise in DBT (Data Build Tool) and modern ETL (Extract Transform Load) development practices.
• Experience with workflow orchestration platforms such as Control-M or Apache Airflow (MWAA).
• Expertise with AWS data services, including Glue, Athena, CloudWatch, and Lambda.
• Knowledge of modern open table formats such as Iceberg and/or Delta Lake.
• Experience with Snowflake administration and development.
• Strong SQL skills and experience with modern database technologies.
• Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.

Preferred qualifications, capabilities, and skills

• Experience with Kafka, Flink, or other streaming technologies.
• Familiarity with AI/ML technologies including LLMs, prompt engineering, vector search, and responsible AI practices.
• Experience using AI-assisted software development tools such as GitHub Copilot, Claude, or similar technologies.
• Financial services industry experience and understanding of large-scale enterprise data environments.
• Experience mentoring engineers and leading technical delivery initiatives.

ABOUT US

Chase is a leading financial services firm, helping nearly half of America's households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

Equal Opportunity Employer/Disability/Veterans

ABOUT THE TEAM

Our Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We're proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions - all while ranking first in customer satisfaction.