Senior Data Engineer — Palmos Platform Pipelines

Next Frontier Capital; Dublin; On-site; EUR 90,000 - 120,000; Full time

Job summary

JPMorganChase is seeking a Data Engineer III to join the Enterprise Platforms team, focusing on onboarding data into Palmos and building scalable data pipelines for analytics, AI/ML, and reporting. The role emphasizes secure, reliable data solutions, collaboration across domain teams, and adherence to data mesh standards.

You will design and maintain pipelines with Python, PySpark, and SQL, leveraging Databricks and cloud platforms, while integrating governance and security practices throughout

Qualifications

• Hands-on experience with Databricks, Spark/PySpark, Python and SQL.
• Experience developing and maintaining data pipelines and data processing systems.
• Understanding of the data lifecycle, including ingestion, transformation, storage, and consumption.
• Knowledge of cloud platforms (AWS) and distributed data processing.
• Experience with SDLC practices including CI/CD, testing, and deployment.
• Strong problem-solving skills and ability to troubleshoot data and pipeline issues.
• Ability to collaborate effectively within agile teams and with stakeholders.
• Hands-on experience using enterprise AI-assisted software development tools and evaluating AI outputs for correctness, performance, and security.
• Understanding of responsible AI use in engineering workflows and data handling.

Responsibilities

• Develop workflows and ELT data pipelines using Python, Spark/PySpark, and Databricks.
• Onboard enterprise datasets into Palmos, including ingestion, transformation, and validation of data assets.
• Build, test, and maintain scalable data pipelines and data architectures for analytics use cases.
• Apply data engineering best practices for performance, reliability, and maintainability.
• Support data security, governance, and entitlements frameworks to protect enterprise data.
• Use SQL extensively and work with both relational and NoSQL data stores.
• Partner with stakeholders to understand data requirements and translate them into production-ready solutions.
• Apply SDLC practices including CI/CD, testing, and operational monitoring to ensure pipeline stability.
• Contribute to reusable frameworks and standards to accelerate onboarding and pipeline delivery.
• Identify data issues, anomalies, and optimization opportunities to improve data quality and performance.
• Leverage enterprise-authorized AI coding assist tools to improve code quality, delivery speed, and productivity; perform peer reviews.
• Apply knowledge of tools within the SDLC toolchain, including enterprise AI-assisted development, to improve automation value.

Skills

Databricks

Spark/PySpark

Python

SQL

Data pipelines

AWS

CI/CD

Problem solving

Collaboration

AI-assisted tooling

Tools

Palmos

Delta Lake

Databricks platform

Job description

JPMorganChase is seeking a Data Engineer III to join the Enterprise Platforms team, focusing on onboarding data into Palmos and building scalable data pipelines for analytics, AI/ML, and reporting. The role emphasizes secure, reliable data solutions, collaboration across domain teams, and adherence to data mesh standards.

You will design and maintain pipelines with Python, PySpark, and SQL, leveraging Databricks and cloud platforms, while integrating governance and security practices throughout