Senior Data Engineering Lead: Databricks & Big Data Platforms

JPMorgan Chase & Co.; Dublin; On-site; EUR 120,000 - 180,000; Full time

Job summary

JPMorgan Chase & Co. seeks a Manager of Software Engineering to lead a team of engineers in Employee Platforms. You will guide the design, development, and optimization of secure, scalable software components and data pipelines.

You will collaborate with cross-functional partners to advance technical direction and deliver high-impact solutions across distributed teams, mentoring engineers along the way.

Qualifications

• Experience leading data integration projects in large organizations.
• Proven ability to manage engineering teams.
• Hands-on experience with AWS data services and Databricks.
• Strong Spark/Scala or PySpark skills for scalable pipelines.
• Familiarity with data formats and warehousing concepts.

Responsibilities

• Lead data integration and analytics across diverse systems.
• Design and implement extensible data acquisition and integration solutions.
• Develop ETL/ELT processes to extract, transform, and distribute data.
• Provide expert problem-solving for BI integrations.
• Collaborate with product and cross-functional teams.
• Coordinate with remote and distributed teams to deliver products.

Skills

Data integration

Big Data

AWS

Spark

Kafka

CI/CD

Java

Python/Scala

Databricks

CloudFormation

Terraform

Jenkins

Git

SQL/NoSQL

Data Modeling

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

S3

EMR

Lambda

Airflow

JVM ecosystem

Job description

JPMorgan Chase & Co. seeks a Manager of Software Engineering to lead a team of engineers in Employee Platforms. You will guide the design, development, and optimization of secure, scalable software components and data pipelines.

You will collaborate with cross-functional partners to advance technical direction and deliver high-impact solutions across distributed teams, mentoring engineers along the way.