Senior Data Engineer - Python, Databricks & AWS

JP Morgan Chase; Plano (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

JPMorgan Chase is seeking a Software Engineer to join Corporate Technology - Global Finance Technology. You will contribute to data pipelines, analytics infrastructure, and secure, scalable data architectures across business functions.

As a senior technical contributor, you will own ingestion, governance, and performance tuning in a Databricks AWS environment, with emphasis on reliability, testing, and secure coding practices.

Qualifications

• Formal training or certification in software engineering; 5+ years hands-on SDLC experience.
• Experience building and maintaining data pipelines.
• Hands-on experience with Databricks Lakehouse hosted in AWS.
• Experience with Delta Lake (ACID tables, partitioning, schema evolution).
• Proven experience with Spark on Databricks (tuning, clustering).
• Experience with streaming and batch pipelines (Structured Streaming, incremental processing).
• Strong AWS fundamentals for data platforms (S3, IAM, KMS, VPC).
• Data governance/security controls in Databricks (Unity Catalog, permissions).
• Reliability: monitoring, incident response, RCA, SLO/SLA management.
• Awareness of responsible AI use in engineering workflows.

Responsibilities

• Deliver ingestion at scale from AWS sources into Databricks (batch + streaming).
• Build maintainable pipelines using Delta Live Tables or Jobs with tests and docs.
• Operationalize workloads via Databricks Workflows/Jobs; ensure retries, checkpointing, idempotency.
• Enforce governance, least privilege, auditing, lineage and controlled sharing.
• Tune Spark/Delta workloads, right-size clusters, optimize storage and costs.
• Implement CI/CD and IaC (Terraform) for Databricks + AWS resources; promote across environments.
• Conduct unit/integration tests for transformations, data quality, and backfills.
• Maintain runbooks and clear documentation; participate in peer reviews.

Skills

Data engineering

Databricks

Spark

Delta Lake

Terraform

AWS

Data governance

CI/CD

AI tooling

Code review

Tools

Databricks

Delta Lake

Terraform

AWS

Spark

Job description

JPMorgan Chase is seeking a Software Engineer to join Corporate Technology - Global Finance Technology. You will contribute to data pipelines, analytics infrastructure, and secure, scalable data architectures across business functions.

As a senior technical contributor, you will own ingestion, governance, and performance tuning in a Databricks AWS environment, with emphasis on reliability, testing, and secure coding practices.