Lead Software Engineer - Data Engineering | Data Technology

JPMorganChase; Columbus (OH); On-site; USD 120,000 - 150,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a seasoned data engineer to design, build, and optimize large-scale ETL pipelines in a cloud-first environment.

You will develop Python applications, leverage PySpark, and ensure high-quality, scalable data solutions for critical business insights. You will work with cutting-edge technologies such as Iceberg/Delta Lake, Snowflake, and AWS services, and participate in code reviews, testing, and CI/CD adoption.

Qualifications

• 5+ years of data engineering experience in a corporate environment.
• Proficiency in Python, PySpark, SQL and ETL development.
• Experience with distributed data processing and data lake architectures.

Responsibilities

• Design and optimize large-scale ETL data pipelines.
• Develop Python applications with modular code and tests.
• Build distributed data processing with PySpark.
• Implement orchestration with Airflow/MWAA and Control-M.
• Develop cloud-native solutions on AWS (Glue, Athena, Lambda).
• Manage data lake architectures with Iceberg/Delta Lake.
• Administer Snowflake environments and security.
• Lead code reviews and promote CI/CD practices.

Skills

Python

PySpark

SQL

Airflow

MWAA

AWS

DBT

Snowflake

Education

Bachelor's degree in Computer Science or related field

Master's degree in Data Engineering or related field

Tools

Control-M

Iceberg

Delta Lake

Glue

Terraform

Git

CI/CD

Job description

This is your chance to change the path of your career and work at one of the world's leading financial institutions.

Job Responsibilities

• Design, develop, and optimize large-scale ETL (Extract Transform Load) data pipelines.
• Build high-quality Python applications using modular code, reusable components, logging, and automated testing.
• Develop and maintain distributed data processing solutions using PySpark.
• Large scale end-to-end testing design and validation.
• Implement and support workflow orchestration using Control-M or Apache Airflow (MWAA).
• Develop cloud-native solutions leveraging AWS services, including Glue, Athena, Lambda, and CloudWatch.
• Design and manage modern data lake architectures utilizing Iceberg and/or Delta Lake.
• Administer and optimize Snowflake environments, including streams, tasks, roles, and warehouses.
• Participate in code reviews and champion engineering best practices, testing standards, and CI/CD processes.
• Leverage approved AI-assisted development tools while ensuring secure, responsible, and compliant software delivery.

Required Qualifications, Capabilities, And Skills

• Formal training or certification on software engineering concepts and 5+ years applied experience with a strong focus on data engineering.
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages – Python (primary) & Java (secondary)
• Hands‑on experience with PySpark or other distributed data processing frameworks.
• Strong expertise in DBT (Data Build Tool) and modern ETL (Extract Transform Load) development practices.
• Experience with workflow orchestration platforms such as Control-M or Apache Airflow (MWAA).
• Expertise with AWS data services, including Glue, Athena, CloudWatch, and Lambda.
• Knowledge of modern open table formats such as Iceberg and/or Delta Lake.
• Experience with Snowflake administration and development.
• Strong SQL skills and experience with modern database technologies.
• Drives team adoption of enterprise-authorized AI-assisted engineering practices within the work environment to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test strategy acceleration, incident/root-cause analysis support), while establishing consistent validation standards (secure coding, peer review, automated testing) and promoting reuse of effective patterns across the team.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.

Preferred Qualifications, Capabilities, And Skills

• Experience with Kafka, Flink, or other streaming technologies.
• Familiarity with AI/ML technologies including LLMs, prompt engineering, vector search, and responsible AI practices.
• Experience using AI-assisted software development tools such as GitHub Copilot, Claude, or similar technologies.
• Financial services industry experience and understanding of large-scale enterprise data environments.
• Experience mentoring engineers and leading technical delivery initiatives.

About Us

Chase is a leading financial services firm, helping nearly half of America's households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

Equal Opportunity Employer/Disability/Veterans

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

About The Team

Our Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We're proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions – all while ranking first in customer satisfaction.