Lead ML & Cloud Data Engineer (Databricks + AWS)

JPMorgan Chase & Co.; Plano (TX); On-site; USD 180,000 - 240,000; Full time

Job summary

JPMorgan Chase & Co. in Plano, TX seeks a Lead Software Engineer, Machine Learning and Cloud, to drive high-performance data pipelines and secure, scalable platforms.

You will lead architecture, implement Delta Lake based lakehouse patterns, and champion AI-assisted engineering practices within an agile team to deliver trusted technology products across the enterprise. Applicants should have 8+ years in software/data engineering, with strong Python/Java, Databricks expertise, and experience in

Qualifications

• Formal training or certification in software engineering.
• 8+ years of professional software/data engineering experience, including production work with Spark on Databricks or EMR.
• Experience leading AI-assisted development tools with emphasis on correctness, performance, and security.
• Strong understanding of responsible AI usage and secure data handling.

Responsibilities

• Lead architecture and delivery of high-throughput data pipelines using Databricks and Spark.
• Establish lakehouse patterns with Delta Lake and ensure performance at scale.
• Drive enterprise AI-assisted engineering practices and secure coding standards.
• Own Databricks cluster strategy, workflows, and integration with AWS services.

Skills

Databricks

Spark

Python

Java

Airflow

CI/CD

Security

Responsible AI

Data Engineering

Delta Lake

Education

Formal training or certification in software engineering

Tools

Databricks

EMR

Unity Catalog

Terraform

Airflow

Job description

JPMorgan Chase & Co. in Plano, TX seeks a Lead Software Engineer, Machine Learning and Cloud, to drive high-performance data pipelines and secure, scalable platforms.

You will lead architecture, implement Delta Lake based lakehouse patterns, and champion AI-assisted engineering practices within an agile team to deliver trusted technology products across the enterprise. Applicants should have 8+ years in software/data engineering, with strong Python/Java, Databricks expertise, and experience in