Databricks Technical Lead

G MASS Consulting; Dublin; On-site; EUR 95,000 - 130,000; Full time

Job summary

G MASS Consulting is seeking an experienced Databricks Technical Lead to shape the architecture and ownership of strategic data platforms within a financial services environment. You will drive technical direction across Databricks and the AWS estate, ensuring scalable and secure development practices and overseeing delivery through the full SDLC.

You will collaborate with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture to deliver robust,

Qualifications

• Extensive SDLC experience in enterprise environments.
• Financial services experience with banking exposure.
• Strong hands-on Databricks experience (Spark/PySpark, Delta Lake, Databricks SQL, Workflows) and Python/Scala proficiency.
• Experience with Unity Catalog and data governance in regulated settings.
• AWS expertise (EC2, Lambda, ECS, RDS, S3, IAM) and Terraform / IaC experience.
• CI/CD experience using Jenkins and modern tooling.
• Degree in Computer Science or related discipline (or equivalent).
• IBM MQ or similar messaging systems.

Responsibilities

• Lead development and enhancement of strategic data platforms across Databricks and AWS.
• Design, build, and optimize large-scale data pipelines using Spark/PySpark, Delta Lake, and Databricks Workflows.
• Own data governance and access control within Databricks, including Unity Catalog.
• Manage cloud infrastructure deployments using Terraform and IaC best practices.
• Maintain technical documentation and internal knowledge resources.
• Provide technical leadership through mentoring, code reviews, and best practices guidance.
• Support architectural design focusing on scalability, performance, cost efficiency, and reliability.
• Drive CI/CD improvements across cloud and on-premise environments.
• Promote clean coding standards and AI-assisted development tooling.

Skills

Databricks

Spark/PySpark

Python/Scala

AWS

Terraform

CI/CD

Unity Catalog

Data governance

Banking domain

Education

Degree in Computer Science or related discipline

Tools

Databricks

Terraform

Jenkins

Job description

G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment.

The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems.

Responsibilities:

• Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments
• Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows
• Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation
• Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices
• Maintain technical documentation and internal knowledge resources
• Provide technical leadership through mentoring, code reviews, and best practice guidance
• Support architectural design with a focus on scalability, performance, cost efficiency, and reliability
• Drive CI/CD improvements across cloud and on-premise environments
• Promote clean coding standards, automated testing, and effective use of AI-assisted development tools

G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment.

The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems.

Responsibilities:

• Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments
• Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows
• Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation
• Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices
• Maintain technical documentation and internal knowledge resourcesProvide technical leadership through mentoring, code reviews, and best practice guidance
• Support architectural design with a focus on scalability, performance, cost efficiency, and reliability
• Drive CI/CD improvements across cloud and on-premise environments
• Promote clean coding standards, automated testing, and effective use of AI-assisted development tools

Requirements:

• Enterprise SDLC experience
• Financial services experience, including banking exposure
• Strong hands-on Databricks experience, including Spark / PySpark, Delta Lake, Databricks SQL, and Workflows, with proficiency in Python and / or Scala
• Experience of Unity Catalog and data governance within a regulated environment
• Strong AWS experience (EC2, Lambda, ECS, RDS, S3, IAM)Hands-on Terraform / Infrastructure as Code experience
• CI/CD experience using Jenkins
• Degree in Computer Science or related discipline (or equivalent experience)
• IBM MQ or similar messaging systems

Benefits

Length: Permanent

Location: Cork, Dublin, or Amsterdam