Senior Data Engineer - Databricks/Spark on AWS

JPMorganChase; Columbus (OH); On-site; USD 120,000 - 150,000; Full time

Job summary

JPMorganChase is seeking a Software Engineer III in Columbus, OH to advance data engineering on the Employee and Experience Technology team. You will design and deliver secure, scalable data solutions, building Databricks pipelines with PySpark and applying lakehouse patterns to modernize the firm’s data platform.

You will work on end-to-end data ingestion, modeling, and quality checks using Delta Lake, with strong emphasis on performance, reliability, and security in a fast-paced agile

Qualifications

• 3+ years of applied experience in data engineering including design, development, testing, and operations.
• Advanced, hands-on expertise in Apache Spark (PySpark) and production pipelines on Databricks (Delta Lake).
• StrongAWS data ecosystem experience (S3, EMR, Glue, Lambda, Athena).
• Proficient in Python and SQL; familiarity with Java/Scala is a plus.

Responsibilities

• Design, build, and maintain Databricks pipelines using PySpark with production-grade code.
• Optimize PySpark jobs and Databricks clusters for performance and cost.
• Implement scalable data frameworks and lakehouse patterns (bronze/silver/gold).
• Implement data quality checks with Delta Lake and Delta Live Tables; ensure data reliability.
• Set up monitoring and alerting using Databricks, AWS CloudWatch; ensure operational stability.
• Leverage AI tools to accelerate development and improve productivity.
• Deliver curated datasets to BI partners (Sigma, Tableau, Alteryx).
• Collaborate with stakeholders to gather requirements and produce architecture artifacts.

Skills

PySpark

Databricks

Delta Lake

AWS data ecosystem

Python

SQL

CI/CD

Airflow

Autosys

Spark

Education

Bachelor's degree in Computer Science or related field

Tools

Jenkins

Spinnaker

Git/Bitbucket

Databricks

Job description

JPMorganChase is seeking a Software Engineer III in Columbus, OH to advance data engineering on the Employee and Experience Technology team. You will design and deliver secure, scalable data solutions, building Databricks pipelines with PySpark and applying lakehouse patterns to modernize the firm’s data platform.

You will work on end-to-end data ingestion, modeling, and quality checks using Delta Lake, with strong emphasis on performance, reliability, and security in a fast-paced agile