Senior Big Data Engineer - Data Warehousing & Spark

Next Frontier Capital; Dublin; On-site; EUR 90,000 - 120,000; Full time

Job summary

JPMorgan Chase is seeking a Software Engineer III within Employee Platforms to design, develop, and deliver secure, scalable software solutions. You will collaborate with colleagues to enhance products and tackle complex data challenges, driving innovation and growth in a fast-paced environment.

The role emphasizes data integration, big data analytics, and distributed systems, with opportunities to grow within a collaborative, mentoring-driven team across distributed locations.

Qualifications

• Experience in data integration projects using Big Data technologies.
• Hands-on experience with AWS Data Warehousing and Databricks.
• Strong CI/CD experience with Jenkins, Git, YAML and Maven.
• Proficiency in Spark engineering with PySpark or Scala.
• Knowledge of data warehousing, data modeling, data lake and data security.
• Experience with Oracle/MySQL and NoSQL stores like DynamoDB.
• Ability to learn new technologies quickly in a dynamic environment.

Responsibilities

• Manage data integration and analysis across diverse systems.
• Build data acquisition and integration solutions to meet client requirements.
• Implement ETL processes to extract, transform, and distribute data.
• Provide expertise in data analysis for business intelligence integration.
• Collaborate with internal product development and cross-functional teams.
• Work with remote and geographically distributed teams to deliver products.

Skills

Big Data technologies

Data integration

AWS Data Warehousing

Databricks

CI/CD

Jenkins

Git

PySpark

Spark

Java

NoSQL datastores

SQL

Data modeling

Data security

Apache Airflow

Terraform/CloudFormation

Tools

Databricks

Terraform

CloudFormation

Airflow

Maven

Job description

JPMorgan Chase is seeking a Software Engineer III within Employee Platforms to design, develop, and deliver secure, scalable software solutions. You will collaborate with colleagues to enhance products and tackle complex data challenges, driving innovation and growth in a fast-paced environment.

The role emphasizes data integration, big data analytics, and distributed systems, with opportunities to grow within a collaborative, mentoring-driven team across distributed locations.