Senior Data & AI Platform Engineer

JPMorgan Chase & Co.; Jersey City (NJ); On-site; USD 61,000 - 101,000; Full time

Job summary

JPMorganChase in Jersey City seeks a senior software/data platform engineer to design, build, and operate scalable data pipelines and lakehouse capabilities using Spark, Airflow, Kafka, Flink, and Kubernetes.

You will apply data modeling, CI/CD, and governance practices, work with Databricks, AWS services, and agentic AI topics, and partner with analytics teams to deliver production-ready solutions.

Qualifications

• Formal training or certification in software engineering concepts.
• 5+ years of hands-on software/data platform experience.
• Experience delivering system design, application development, testing, and operational stability.
• Proven experience in software engineering or data platform development.
• Advanced proficiency in Python, Java, and SQL.
• Hands-on experience with Spark, Flink, and related distributed processing frameworks.
• Strong data modeling skills (star/snowflake schemas) and query optimization.
• Experience building data pipelines on Databricks using Airflow.
• Proficiency with cloud data services (AWS S3/Glue/Redshift/Athena/EMR, Lake Formation).
• Experience building production-grade data platforms on Kubernetes with catalog integration (Iceberg,Unity Catalog, OpenMetadata).
• Understanding of CI/CD, application resiliency, and security.
• Experience developing Agentic AI, LLMs, RAG, MCP, vector databases, and embedding-based retrieval.

Responsibilities

• Design, build, and maintain scalable data pipelines and ETL/ELT workflows for batch and real-time processing using Spark, Airflow, Kafka, and Flink.
• Develop data platform capabilities including data cataloging, data quality, governance, lineage, and compliance.
• Implement data modeling strategies to support analytics, reporting, and downstream use.
• Partner with analytics teams, product managers, and stakeholders to deliver production-ready data solutions.
• Produce secure, high-quality production code; review and debug others' code.
• Identify and automate remediation to strengthen operational stability across apps and systems.
• Lead evaluation sessions with vendors and teams to assess architectures and fit within information architecture.
• Drive development of Agentic Autonomous Lakehouse capabilities and governance automation.
• Lead communities of practice to promote adoption of new technologies.

Skills

Python

Java

SQL

CI/CD

Agile

Data modeling

Distributed processing

Tools

Apache Spark

Flink

Databricks

Airflow

Docker

Kubernetes

Terraform

Iceberg/Open metadata

Job description

JPMorganChase in Jersey City seeks a senior software/data platform engineer to design, build, and operate scalable data pipelines and lakehouse capabilities using Spark, Airflow, Kafka, Flink, and Kubernetes.

You will apply data modeling, CI/CD, and governance practices, work with Databricks, AWS services, and agentic AI topics, and partner with analytics teams to deliver production-ready solutions.