Lead Data Engineer - PySpark/Databricks on AWS

JPMorgan Chase; Wilmington (DE); On-site; USD 140,000 - 190,000; Full time

Job summary

JPMorganChase is seeking a Lead Data Engineer to advance data collection, storage, access, and analytics solutions within Corporate Technology. The role focuses on secure, scalable pipelines and data models, using PySpark, Databricks, SQL, and AWS, with emphasis on AI-assisted workflows and strong validation.

The position requires 5+ years in data engineering, enterprise-grade tooling, and experience with relational and NoSQL databases.

Qualifications

• Formal training or certification on data engineering concepts and 5+ years applied experience.
• Strong experience with Python, PySpark, Databricks, SQL, AWS and AI automation.
• Proficient in and experience across the data lifecycle.
• Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
• Ability to review and validate AI-assisted outputs before use, escalating when uncertain and following data handling requirements.
• Working experience with both relational and NoSQL databases.

Responsibilities

• Delivers data collection, storage, access, and analytics data platform solutions in a secure, stable, and scalable way.
• Uses enterprise-authorized AI capabilities within the work environment to accelerate data platform and model design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.
• Generates data models for the team using firmwide approaches, linear algebra, statistical and geometrical algorithms.
• Implements database back-up, recovery, and archiving strategy.
• Evaluates and reports on access control processes to determine effectiveness of data asset security with minimal supervision.
• Applies reuse-first, AI-assisted practices within delivery and operational routines (e.g., backup/recovery validation and access control review support), ensuring traceability/auditability and alignment to resiliency and security expectations.

Skills

Python

PySpark

Databricks

SQL

AWS

AI automation

Data lifecycle

Education

Formal training or certification in data engineering

Tools

Relational databases

NoSQL databases

Job description

JPMorganChase is seeking a Lead Data Engineer to advance data collection, storage, access, and analytics solutions within Corporate Technology. The role focuses on secure, scalable pipelines and data models, using PySpark, Databricks, SQL, and AWS, with emphasis on AI-assisted workflows and strong validation.

The position requires 5+ years in data engineering, enterprise-grade tooling, and experience with relational and NoSQL databases.