Lead Data Platform Engineer - Snowflake & Databricks (AWS)

Creditsafe Group; Dublin; Hybrid; EUR 90,000 - 135,000; Full time

Benefits offered by this job

Competitive salary

Bonus scheme

25 days annual leave

Hybrid working model

Healthcare & pension

Job summary

Creditsafe is building a new data and AI platform with a focus on data quality, lineage and auditability. The role involves integrating AWS data platforms with Snowflake and Databricks, and delivering scalable data pipelines in Python.

You will work on both batch and streaming processes to support high-throughput data processing and AI capabilities on top of the platform, with a strong emphasis on collaboration and code quality.

Qualifications

• Proven track record deploying and operating production data platforms using Python and AWS.
• Hands-on experience with modern cloud data platforms including Snowflake and Databricks.
• Ability to implement data engineering best practices and deliver production grade pipelines.

Responsibilities

• Contribute to codebase and participate in peer reviews.
• Design and build metadata driven, event-based distributed data processing platforms (Python, Spark, Airflow, Iceberg, DynamoDB, AWS Glue, S3).
• Integrate the AWS data lake with Snowflake and Databricks.
• Lead design, development, and deployment of critical data systems.
• Build and scale data pipelines with batch and streaming approaches for sub-100ms latency serving.
• Understand domain data to improve the product.
• Develop AI-based solutions using semantic search and agentic workflows.
• Utilize AI tools to aid development processes.

Skills

Python

AWS

Snowflake

Databricks

Spark

Airflow

DynamoDB

S3

Terraform

CI/CD

Linux

Redshift

API Gateway

Tools

Snowflake

Databricks

AWS

Terraform

Airflow

Job description

Creditsafe is building a new data and AI platform with a focus on data quality, lineage and auditability. The role involves integrating AWS data platforms with Snowflake and Databricks, and delivering scalable data pipelines in Python.

You will work on both batch and streaming processes to support high-throughput data processing and AI capabilities on top of the platform, with a strong emphasis on collaboration and code quality.