Databricks Technical Lead

G MASS Consulting; Dublin; On-site; EUR 90,000 - 120,000; Full time

Job summary

G MASS Consulting is seeking an experienced Databricks Technical Lead to own strategic data platforms for a financial services client. You will define technical direction across Databricks and the AWS estate, ensuring scalable, secure development and delivery through the SDLC.

You will collaborate with Development, QA, IT Security, and Enterprise Architecture to deliver robust, high‑performing solutions across complex banking systems.

Responsibilities

• Lead development of banking data platforms on Databricks and AWS.
• Design and optimise Spark/PySpark pipelines with Delta Lake.
• Own data governance and Unity Catalog design.
• Manage Terraform and IaC based cloud deployments.
• Maintain documentation and knowledge resources.
• Provide technical leadership via mentoring and reviews.
• Focus on scalability, performance, cost efficiency and reliability.
• Drive CI/CD improvements across cloud and on‑premise.
• Promote clean code, automated tests and AI-assisted tooling.

Job description

G MASS are seeking an experienced Databricks Technical Lead to support the development and ownership of strategic data platforms and cloud-based applications within a financial services environment.The role will focus on defining technical direction and architecture across Databricks and the wider AWS estate, ensuring scalable and secure development practices, and overseeing delivery through the full software development lifecycle. The successful candidate will work closely with Development, Business Analysis, QA, Application Support, IT Security, and Enterprise Architecture teams to deliver robust and high-performing solutions across complex banking and financial systems.

Responsibilities:

• Lead the development and enhancement of strategic banking data platforms and applications across Databricks and AWS cloud environments
• Design, build, and optimise large-scale data pipelines using Spark / PySpark, Delta Lake, and Databricks Workflows
• Own data governance and access control within the Databricks environment, including Unity Catalog design and implementation
• Manage cloud infrastructure deployments using Terraform and Infrastructure as Code best practices
• Maintain technical documentation and internal knowledge resources
• Provide technical leadership through mentoring, code reviews, and best practice guidance
• Support architectural design with a focus on scalability, performance, cost efficiency, and reliability
• Drive CI/CD improvements across cloud and on-premise environments
• Promote clean coding standards, automated testing, and effective use of AI-assisted development tools