Databricks Tech Lead: Data Platforms & Cloud Architecture

G MASS Consulting

Dublin

On-site

EUR 95,000 - 130,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

G MASS Consulting is seeking an experienced Databricks Technical Lead to shape the architecture and ownership of strategic data platforms within a financial services environment. You will drive technical direction across Databricks and the AWS estate, ensuring scalable and secure development practices and overseeing delivery through the full SDLC.

You will collaborate with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture to deliver robust,

Qualifications

Extensive SDLC experience in enterprise environments.
Financial services experience with banking exposure.
Strong hands-on Databricks experience (Spark/PySpark, Delta Lake, Databricks SQL, Workflows) and Python/Scala proficiency.
Experience with Unity Catalog and data governance in regulated settings.
AWS expertise (EC2, Lambda, ECS, RDS, S3, IAM) and Terraform / IaC experience.
CI/CD experience using Jenkins and modern tooling.
Degree in Computer Science or related discipline (or equivalent).
IBM MQ or similar messaging systems.

Responsibilities

Lead development and enhancement of strategic data platforms across Databricks and AWS.
Design, build, and optimize large-scale data pipelines using Spark/PySpark, Delta Lake, and Databricks Workflows.
Own data governance and access control within Databricks, including Unity Catalog.
Manage cloud infrastructure deployments using Terraform and IaC best practices.
Maintain technical documentation and internal knowledge resources.
Provide technical leadership through mentoring, code reviews, and best practices guidance.
Support architectural design focusing on scalability, performance, cost efficiency, and reliability.
Drive CI/CD improvements across cloud and on-premise environments.
Promote clean coding standards and AI-assisted development tooling.