Senior Databricks Data Engineer – AWS Lakehouse & AI

Citco Group of Companies; Dublin; On-site; EUR 70,000 - 95,000; Full time

Benefits offered by this job

Flexible working arrangements

Training and education support

Inclusive culture

Diversity hiring practices

Job summary

A leading financial services firm is seeking a Senior Data Engineer for its Dublin office. In this role, you'll leverage Databricks for data processing and integration, collaborating with teams to drive data initiatives in a cloud environment. You will need extensive experience in data engineering and cloud services, particularly AWS, along with strong Python and Spark skills. The firm offers a range of benefits and embraces a diverse workplace culture.

Qualifications

• Strong expertise in Python and Spark programming.
• Proven experience with AWS or other similar cloud services.
• Deep understanding of data modeling and SQL.

Responsibilities

• Design and develop Databricks solutions for data processing.
• Develop and optimize ETL/ELT pipelines.
• Create and manage structured streaming pipelines.

Skills

Data engineering experience

Python expertise

Spark programming

AI knowledge

Data modeling

ETL/ELT principles

Strong problem-solving skills

Excellent communication

Education

6+ years of experience in data engineering

2+ years with Databricks platform

Tools

Databricks

AWS

Delta Lake

Git

Job description

A leading financial services firm is seeking a Senior Data Engineer for its Dublin office. In this role, you'll leverage Databricks for data processing and integration, collaborating with teams to drive data initiatives in a cloud environment. You will need extensive experience in data engineering and cloud services, particularly AWS, along with strong Python and Spark skills. The firm offers a range of benefits and embraces a diverse workplace culture.