Lead Data Engineer: Scalable Cloud Pipelines & Security

Next Frontier Capital; Chicago (IL); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Competitive compensation

Health benefits

Retirement plan

Education reimbursement

Job summary

JPMorgan Chase & Co. in Chicago is seeking a Lead Data Engineer to design, implement, and maintain data pipelines that ingest, process, and store large volumes of data from diverse sources.

The role emphasizes timeliness, data quality, privacy compliance, and secure data handling in line with financial regulations and firm-wide policies. You will collaborate with technical and business teams to define target state, evaluate new technologies, and deliver reliable, scalable data solutions using

Qualifications

• Proficiency in designing scalable data architectures and pipelines for ingestion and processing.
• Experience with batch and streaming ETL/ELT pipelines.
• Knowledge of data residency and privacy regulations in financial services.

Responsibilities

• Design, implement, and maintain data pipelines for large-scale data ingestion and processing.
• Collaborate with stakeholders to meet current and future data needs.
• Drive technical direction and evaluate new technologies.

Skills

Java

Python

SQL

Data pipelines

Kafka

Snowflake

Databricks

Cloud (GCP/AWS)

Data security & privacy

Observability & SLIs

Tools

Spark

Flink

Dataflow

Job description

JPMorgan Chase & Co. in Chicago is seeking a Lead Data Engineer to design, implement, and maintain data pipelines that ingest, process, and store large volumes of data from diverse sources.

The role emphasizes timeliness, data quality, privacy compliance, and secure data handling in line with financial regulations and firm-wide policies. You will collaborate with technical and business teams to define target state, evaluate new technologies, and deliver reliable, scalable data solutions using