Lead Data Platform Engineer - Databricks on AWS

Fairygodboss; Plano (TX); On-site; USD 130,000 - 180,000; Full time

Benefits offered by this job

Health care coverage

On-site health centers

Retirement plan

Backup childcare

Tuition reimbursement

Mental health support

Financial coaching

more

Job summary

JPMorgan Chase & Co. in Plano, TX is seeking a Lead Software Engineer to design, develop, and maintain scalable data processing solutions using Databricks, Python, and AWS.

You will collaborate with cross-functional teams to deliver high-quality data solutions that support our business objectives. You will lead the full SDLC for data pipelines, drive observability and security by design, mentor engineers, and adopt enterprise AI-assisted development practices to improve code quality and delivery

Qualifications

• 5+ years of applied software engineering experience.
• Strong SQL, Python, and PySpark for large-scale data processing.
• Experience with Databricks/Spark and AWS data lake patterns.
• Proven ability to design platform services and API-driven components.
• Focus on data quality, security, and observability throughout pipelines.

Responsibilities

• End-to-end data-driven software solutions design and troubleshooting.
• Design and build a control plane for enterprise data pipelines.
• Develop self-service APIs/SDKs and configuration-driven onboarding.
• Design, develop, and maintain scalable data pipelines and models.
• Ensure data quality, security, lineage, and observability.
• Lead full SDLC with production support and reliability improvements.
• Collaborate with stakeholders to shape data management strategy.
• Mentor engineers and promote modern engineering practices, including AI-assisted tooling.
• Drive adoption of enterprise-authorized AI-assisted engineering practices.

Skills

Python

SQL

PySpark

Databricks

AWS

Data management

CI/CD

Observability

AI-assisted development

Education

Formal software engineering training

Tools

Databricks

Jenkins

Terraform

CloudFormation

Job description

JPMorgan Chase & Co. in Plano, TX is seeking a Lead Software Engineer to design, develop, and maintain scalable data processing solutions using Databricks, Python, and AWS.

You will collaborate with cross-functional teams to deliver high-quality data solutions that support our business objectives. You will lead the full SDLC for data pipelines, drive observability and security by design, mentor engineers, and adopt enterprise AI-assisted development practices to improve code quality and delivery