Corporate Technology - Lead Data Engineer

RiseMe; Chicago (IL); On-site; USD 140,000 - 180,000; Full time

Job summary

JPMorgan Chase & Co. in Chicago seeks a Lead Data Engineer to design, build, and maintain scalable data pipelines and secure distributed architectures for ingestion and processing of large data volumes across sources.

You will ensure data timeliness, quality, and compliance with data residency and privacy regulations, implement secure data-at-rest and in-transit practices, and collaborate with cross-functional teams to drive technology strategy and delivery.

Qualifications

• Design and develop scalable distributed architectures focusing on data ingestion and processing.
• Design, implement, and maintain data pipelines that collect, process, and store large volumes of data with timeliness and quality.
• Ensure data solutions comply with data residency and privacy regulations and secure data at rest and in transit in compliance with financial regulations.
• Engages technical teams and business stakeholders to discuss and propose technical approaches to meet current and future needs.
• Defines the technical target state of their product and drives achievement of the strategy.
• Evaluates recommendations and provides feedback on new technologies.
• Executes creative software solutions, design, and development.

Responsibilities

• Design, implement, and maintain data pipelines for large data volumes (batch and streaming).
• Collaborate with stakeholders to translate requirements into scalable architectures.
• Ensure data security, privacy compliance, and regulatory alignment across platforms.
• Monitor data quality, backfill strategies, and observability for lakehouse systems.
• Evaluate and adopt new technologies to improve data delivery and reliability.

Skills

Java/Python

SQL

ETL/ELT pipelines

Data modeling

Data quality & observability

Cloud architecture

FinOps/cost optimization

Tools

Snowflake

Databricks

Kafka

Spark

Parquet

Delta Lake

Iceberg

Job description

Join a team that designs and develops scalable and secure distributed architectures and solutions, focusing on data ingestion and processing utilizing appropriate cloud native technologies and services.

As a Lead Data Engineer, within our Corporate Technology Team, you will design, implement, and maintain data pipelines that efficiently collect, process, and store large volumes of data from various sources, ensuring data timeliness, quality, and completeness, and ensure that data solutions comply with relevant data residency and privacy regulations, and implement best practices for securing data at rest and in transit in compliance with financial regulations and firm wide policies.

Job Qualifications:

• Design and develop scalable and secure distributed architectures and solutions, focusing on data ingestion and processing - utilizing appropriate cloud native technologies and services.
• Data pipeline development: Design, implement, and maintain data pipelines that efficiently collect, process, and store large volumes of data from various sources, ensuring data timeliness, quality, and completeness.
• Security and compliance: Ensure that data solutions comply with relevant data residency and privacy regulations, and implement best practices for securing data at rest and in transit in compliance with financial regulations and firm wide policies.
• Engages technical teams and business stakeholders to discuss and propose technical approaches to meet current and future needs
• Defines the technical target state of their product and drives achievement of the strategy
• Evaluates recommendations and provides feedback on new technologies
• Executes creative software solutions, design, and development

Required Qualifications, capabilities, and skills:

• Programming: Comfortable with Java/Python including sound testing and code review practices.
• SQL expertise: Joins, aggregations, subqueries, window functions
• Data pipelines: Design, build, and optimize production ETL/ELT pipelines (batch + streaming) using a popular framework (Spark, Flink, Dataflow, etc).
• Streaming: Hands-on with Kafka (topics, keys, partitions, consumer groups) at-least-once semantics, and schema registry basics.
• Warehousing/Lakehouse: Data modelling, partitioning, clustering. Hands-on with one ofSnowflake, Databricks, etc, and cloud storage or HDFS.
• Cloud: Production experience with at least one major cloud provider (GCP/AWS) using native data services . FinOps-aware with cost-effective design.
• Reliability: Data quality checks, backfills, incorporating SLIs with observability and reporting and lakehouse platforms and table formats (Delta/Iceberg/Avro/Parquet) and time-travel.

Preferred qualifications, capabilities, and skills:

• Experience with Kafka, Flink, or other streaming technologies.
• Familiarity with AI/ML technologies including LLMs, prompt engineering, vector search, and responsible AI practices and experience using AI-assisted software development tools such as GitHub Copilot, Claude, or similar technologies.
• Financial services industry experience and understanding of large-scale enterprise data environments.
• Experience mentoring engineers and leading technical delivery initiatives.

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.