Senior Databricks Data Engineer | Pipelines & AI/ML

JPMorgan Chase & Co.; Dublin; On-site; EUR 70,000 - 110,000; Full time

Job summary

JPMorganChase is seeking a Data Engineer III in Enterprise Platforms to join an agile team onboarding enterprise data and building scalable pipelines on the Palmos platform. The role focuses on designing secure, reliable data solutions for analytics, reporting, and AI/ML use cases across the firm.

Responsibilities include building ELT workflows, onboarding datasets, and maintaining data architectures while ensuring governance, security, and SDLC compliance.

Qualifications

• Hands-on experience with Databricks, Spark/PySpark, Python, and SQL.
• Experience developing and maintaining data pipelines and data processing systems.
• Understanding of the data lifecycle from ingestion to consumption.
• Knowledge of cloud platforms (AWS) and distributed data processing.
• Experience with SDLC practices including CI/CD, testing, and deployment.
• Strong problem-solving skills and ability to troubleshoot data and pipeline issues.
• Ability to collaborate in agile teams and with stakeholders.
• Experience using AI-assisted software development tools with critical evaluation.

Responsibilities

• Develop workflows and ELT data pipelines using Python, Spark/PySpark, and Databricks.
• Onboard enterprise datasets into Palmos, including ingestion, transformation, and validation.
• Build scalable data pipelines and architectures supporting analytics and AI/ML use cases.
• Apply data engineering best practices for performance, reliability, and maintainability.
• Support data security, governance, and entitlements to protect enterprise data.
• Use SQL across relational and NoSQL stores; translate data requirements into production solutions.
• Apply SDLC practices including CI/CD, testing, and monitoring to ensure stability.
• Contribute to reusable frameworks and standards to accelerate onboarding and delivery.
• Identify data issues and optimization opportunities to improve quality and performance.
• Leverage enterprise AI-assisted tools; validate outputs via reviews, tests, and secure coding.

Skills

Databricks

Spark/PySpark

Python

SQL

AWS

Tools

Databricks

Spark

Python

SQL

AWS

Job description

JPMorganChase is seeking a Data Engineer III in Enterprise Platforms to join an agile team onboarding enterprise data and building scalable pipelines on the Palmos platform. The role focuses on designing secure, reliable data solutions for analytics, reporting, and AI/ML use cases across the firm.

Responsibilities include building ELT workflows, onboarding datasets, and maintaining data architectures while ensuring governance, security, and SDLC compliance.