Lead Data Engineer — AWS, AI-Driven & Big Data

JPMorgan Chase & Co.; Dublin; On-site; EUR 140,000 - 190,000; Full time

Job summary

JPMorgan Chase & Co. in Dublin is seeking a Manager of Software Engineer within the Workforce Technology team.

You will join an agile group focused on designing, developing, and delivering secure, scalable software components for the firm’s technology products. You will lead data integration, embrace AI-assisted engineering practices, and collaborate with cross-functional teams across distributed locations to build reusable, high-performance systems for the enterprise.

Qualifications

• Experience in data integration projects using Big Data Technologies, preferably HR analytics.
• Experience in managing a team of at least 5-10 engineers.
• Experience in AWS Data Warehousing with EMR, S3, AWS Glue, Lambda, Apache Airflow and IaC (Terraform/CloudFormation).
• Hands-on Spark engineering with PySpark/Scala for scalable data pipelines and 2+ years building streaming apps with Kafka.
• Experience leading use of AI-assisted development tools with secure coding practices.
• Strong CI/CD experience (Jenkins, Git, Maven, Cloud deployments).
• Knowledge of SQL/NoSQL data stores such as DynamoDB.

Responsibilities

• Manage data integration and data analysis of disparate systems
• Build extensible data acquisition and integration solutions to meet requirements
• Implement ETL processes to extract, transform, and distribute data across data stores
• Drive adoption of enterprise AI-assisted engineering practices to improve quality and speed
• Provide problem-solving expertise and complex data analysis for BI designs
• Interface with other product teams and cross-functional groups
• Work with remote and distributed teams to build reusable products

Skills

Data integration

Big Data

AWS data warehousing

Spark PySpark

AI-assisted tools

CI/CD

Java Spring

NoSQL DynamoDB

Communication

Job description

JPMorgan Chase & Co. in Dublin is seeking a Manager of Software Engineer within the Workforce Technology team.

You will join an agile group focused on designing, developing, and delivering secure, scalable software components for the firm’s technology products. You will lead data integration, embrace AI-assisted engineering practices, and collaborate with cross-functional teams across distributed locations to build reusable, high-performance systems for the enterprise.