Lead Data Engineer - Databricks, Spark & AWS

JPMorgan Chase & Co.

Kentucky

On-site

USD 120,000 - 185,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

JPMorgan Chase & Co. is seeking a Lead Software Engineer within Corporate Sector, Chief Technology Office, to guide multiple teams and deliver trusted, scalable technology products in a secure environment.

You will be a core technical contributor across diverse business functions to advance the firm’s objectives. You will own Databricks-based data pipelines, lead architecture, and promote AI-assisted engineering practices, data governance, and secure coding standards while aligning with

Qualifications

Formal training or certification in software engineering and 5+ years applied experience.
10+ years of professional software/data engineering experience with Spark on Databricks or EMR.
Experience leading AI-assisted software development tools with validation of outputs for correctness, performance and security.
Strong understanding of responsible AI in engineering workflows and secure handling of data.

Responsibilities

Lead architecture and delivery of high-throughput, low-latency data pipelines using Databricks and Spark.
Establish lakehouse patterns with Delta Lake and ensure performance at scale.
Drive adoption of enterprise AI-assisted engineering practices and secure coding standards.
Own Databricks cluster strategy, autoscaling, and Spark configuration.
Orchestrate jobs with Databricks Workflows and integrate with AWS eventing as needed.
Design secure data ingestion and transformation frameworks using AWS services.