Lead Data Engineer - AWS Data & Spark Pipelines

JPMorganChase; Dublin; On-site; EUR 85,000 - 105,000; Full time

Job summary

JPMorgan Chase is looking for a Manager of Software Engineering within its Workforce Technology team in Dublin, Ireland. This position involves leading a team in enhancing and delivering software solutions while ensuring secure, stable, and scalable operations. The ideal candidate will have extensive experience in data integration projects, strong knowledge of AWS and Big Data technologies, as well as the ability to manage a team effectively. A hands-on approach to development is essential.

Qualifications

• Experience in data integration projects using Big Data Technologies.
• Experience in managing a team of at least 5-10 engineers.
• 5+ years hands-on experience on Spark engineering with PySpark/Scala.

Responsibilities

• Manage data integration and data analysis of disparate systems.
• Build extensible data acquisition and integration solutions.
• Implement processes to extract, transform, and distribute data across data stores.

Skills

Data integration projects using Big Data Technologies

Managing a team of at least 5-10 engineers

AWS Data Warehousing and database platforms

Hands-on experience on Spark engineering with PySpark/Scala

CICD using Jenkins, Git, Artifactory

Big Data querying tools

Integrating data from different types of file-storage formats

Java open-source knowledge

Using AI-assisted developer productivity tools

Building scalable, high-performance distributed services/systems

Data Warehousing and Data Modeling

Oracle/SQL and NoSQL data stores

Job description

JPMorgan Chase is looking for a Manager of Software Engineering within its Workforce Technology team in Dublin, Ireland. This position involves leading a team in enhancing and delivering software solutions while ensuring secure, stable, and scalable operations. The ideal candidate will have extensive experience in data integration projects, strong knowledge of AWS and Big Data technologies, as well as the ability to manage a team effectively. A hands-on approach to development is essential.