Senior Data Engineer (Microsoft Fabric, Databricks, PySpark)

Acuity Analytics; Lisboa; Presencial; EUR 90 000 - 130 000; Tempo integral

Resumo da oferta

Acuity Analytics is seeking an experienced Senior Data Engineer to design, build and evolve modern data platforms using Microsoft Azure technologies. You’ll develop scalable, secure, high‑performing data solutions and provide technical leadership within the engineering team across Fabric, Databricks and Synapse.

You will mentor engineers, promote best practices, and deliver enterprise‑scale data engineering solutions.

Qualificações

• 5+ years' commercial experience as a Data Engineer.
• Strong experience with Microsoft Fabric, Azure Databricks or Azure Synapse.
• Strong PySpark and Spark SQL experience.
• Advanced SQL skills, including stored procedures.
• Experience building ETL/ELT pipelines and modern data platforms.
• Experience with Azure Data Factory or Fabric Data Factory.
• Experience using Azure DevOps, including Boards, Repositories and CI/CD.
• Experience working within Agile/Scrum teams.
• Strong collaboration, communication and mentoring skills.

Responsabilidades

• Design, develop and maintain scalable data solutions using Microsoft Fabric, Azure Databricks and Azure Synapse.
• Build and optimise ETL/ELT pipelines using PySpark, Spark SQL and SQL.
• Develop data integration solutions using Azure Data Factory and Fabric Data Factory.
• Act as a subject matter expert for PySpark and Spark SQL, supporting other engineers.
• Lead technical workstreams and mentor junior engineers.
• Scope and define technical solutions for new features and enhancements.
• Own features through the full software development lifecycle.
• Work with Azure DevOps Boards and Repositories throughout feature delivery.
• Participate in code reviews and promote engineering best practices.
• Ensure data platforms are secure, scalable and high performing.

Conhecimentos

PySpark

Spark SQL

Advanced SQL

Agile/Scrum

Mentoring

Team collaboration

Ferramentas

Microsoft Fabric

Azure Databricks

Azure Synapse

Azure Data Factory

Fabric Data Factory

Azure DevOps

CI/CD

Neo4j

Snowflake

Claude

Descrição da oferta de emprego

Please note: for this role, you must be based in Malta, Bulgaria or Portugal.

The creative mind behind every project. Put your skills to the test to build solutions that continue to shape the world we live in.

About Us

Ascent has recently been acquired by Acuity Analytics. This is both a significant milestone for us and a tremendous opportunity for you.

Acuity Analytics is a business with a strong global reputation, an impressive client base and ambitious growth plans. We deliver deep insights and domain-led digital transformation to high-growth and heavily regulated organisations. To our customers, we bring a partnership that provides the talent, technology and capability to enhance performance and operational efficiency.

About the Role

We're looking for an experienced Senior Data Engineer to help design, build and evolve modern data platforms using Microsoft Azure technologies.

You’ll develop scalable, secure and high‑performing data solutions while providing technical leadership within the engineering team. Working across Microsoft Fabric, Azure Databricks and Azure Synapse, you’ll mentor engineers, contribute to engineering best practices and deliver enterprise‑scale data engineering solutions.

Responsibilities

• Design, develop and maintain scalable data solutions using Microsoft Fabric, Azure Databricks and Azure Synapse.
• Build and optimise ETL/ELT pipelines using PySpark, Spark SQL and SQL.
• Develop data integration solutions using Azure Data Factory and Fabric Data Factory.
• Act as a subject matter expert for PySpark and Spark SQL, supporting other engineers.
• Lead technical workstreams and mentor junior engineers.
• Scope and define technical solutions for new features and enhancements.
• Own features through the full software development lifecycle.
• Work with Azure DevOps Boards and Repositories throughout feature delivery.
• Participate in code reviews and promote engineering best practices.
• Ensure data platforms are secure, scalable and high performing.

Requirements

• 5+ years' commercial experience as a Data Engineer.
• Strong experience with Microsoft Fabric, Azure Databricks or Azure Synapse.
• Strong PySpark and Spark SQL experience.
• Advanced SQL skills, including stored procedures.
• Experience building ETL/ELT pipelines and modern data platforms.
• Experience with Azure Data Factory or Fabric Data Factory.
• Experience using Azure DevOps, including Boards, Repositories and CI/CD.
• Experience working within Agile/Scrum teams.
• Strong collaboration, communication and mentoring skills.

Nice to Have

• Graph database experience (Neo4j)
• Snowflake
• Experience with Claude

Certifications (Preferred)

The following certifications are advantageous but not essential:

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Certified: Fabric Data Engineer Associate (DP-700)
• Databricks Professional Certification
• Snowflake Certification

Why Join Us

People are at the heart of our business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive.

You’ll have the opportunity to:

• Work across Microsoft Fabric, Azure Databricks and Azure Synapse.
• Influence engineering standards and best practices.
• Mentor engineers and contribute to technical leadership.
• Work within a collaborative team solving complex data engineering challenges.