Data engineer

Acuity Analytics; Lisboa; On-site; EUR 60,000 - 90,000; Full time

Job summary

Acuity Analytics is seeking a Senior Data Engineer to design, build, and optimize modern data platforms on the Microsoft Azure ecosystem. You will develop scalable data pipelines, transform complex datasets, and unlock data value using Fabric, Databricks, and Azure services within a collaborative engineering team.

Your work will cover ETL/ELT development, lakehouse and warehouse designs, and governance practices to ensure performance and reliability across enterprise data platforms.

Qualifications

• 5+ years of experience as a Data Engineer.
• Strong SQL and PySpark skills.
• Experience with Microsoft Fabric, Azure Databricks and Azure Synapse Analytics.
• Experience building data pipelines using Azure Data Factory or Fabric Data Factory.
• Experience with cloud-based data platforms and data governance practices.

Responsibilities

• Design, build and maintain scalable data pipelines on Azure/Fabric.
• Develop ETL/ELT processes using PySpark and SQL.
• Implement data integration using Azure Data Factory and Fabric Data Factory.
• Design scalable lakehouse and data warehouse architectures.
• Collaborate with data scientists and analysts to deliver data solutions.

Skills

PySpark

SQL

Azure Databricks

Azure Synapse

Microsoft Fabric

Azure Data Factory

ETL/ELT

Data pipelines

Cloud platforms

Tools

Power BI

Job description

Описание:

We're looking for a Senior Data Engineer to design, build and optimise modern data platforms using the Microsoft Azure ecosystem. You'll develop scalable data pipelines, transform complex datasets, and help organisations unlock the value of their data through Microsoft Fabric, Databricks and Azure services. Working within a collaborative engineering team, you'll contribute to cloud-native data solutions, ensuring performance, scalability and best practices across enterprise data platforms.

Задачи:

Design, develop and maintain scalable data pipelines using Microsoft Fabric, Azure Databricks and Azure Synapse. Develop ETL/ELT solutions using PySpark and SQL. Build and optimise data integration solutions using Azure Data Factory and Microsoft Fabric. Design scalable lakehouse and data warehouse solutions. Optimise data performance, reliability and quality across cloud platforms. Collaborate with data scientists, analysts and software engineers to deliver business solutions. Implement data governance, security and best practices. Participate in code reviews and contribute to engineering standards. Troubleshoot production issues and continuously improve platform performance.

Требования:

for this role, you must be based in UK, Malta, Bulgaria, or Portugal Strong commercial experience as a Data Engineer (5+ years). Strong experience with PySpark. Advanced SQL skills. Experience with Microsoft Fabric, Azure Databricks and/or Azure Synapse Analytics. Experience building data pipelines using Azure Data Factory (ADF), Synapse Pipelines or Microsoft Fabric Data Factory. Experience working with cloud-based data platforms. Excellent problem-solving and communication skills.

Будет плюсом:

• Power BI
• Graph Database experience
• Node.js
• REST API development
• LLM / Generative AI experience
• Data Science experience
• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Microsoft Certified: Fabric Data Engineer Associate (DP-700)

Условия:

People are at the Heart of our Business. By investing in people, we achieve exceptional results for our clients and create new opportunities for our teams to thrive.