Senior Data Engineer: Databricks, Azure & AI Data Products

Acuity Analytics; Portugal; Presencial; EUR 65 000 - 100 000; Tempo integral

Resumo da oferta

Acuity Analytics is seeking a Senior Data Engineer to turn complex data into commercial, customer-facing products. You’ll work with Databricks, Azure, Python and PySpark to build scalable data solutions and explore AI capabilities.

In this hands-on role you’ll split time across engineering, mentoring and exploration, collaborating with product and commercial teams to bring ideas into production and accelerate value from data for customers.

Qualificações

• Hands-on experience with Databricks.
• Advanced Python, PySpark and SQL.
• Strong experience building scalable data pipelines and data models.
• Experience with Azure or another major cloud platform.
• Experience building APIs and exposing data to applications or customers.
• Experience with data products or customer-facing data solutions.
• Exposure to Generative AI / LLMs and real-world AI use cases.
• Familiarity with RAG, embeddings, vector databases or semantic search.
• Strong communication skills and confidence working with technical, product and commercial stakeholders.
• A product mindset – you think about how data creates value, not just how it moves from A to B.

Responsabilidades

• Build scalable data products and customer-facing data solutions.
• Develop production-ready pipelines using Databricks, Python, PySpark and SQL.
• Transform raw data into structured, enriched and commercially valuable datasets.
• Build and integrate APIs to expose data and power products.
• Apply LLMs, RAG and Generative AI to classification, enrichment, search and insight generation.
• Work with structured and unstructured data, embeddings and semantic search.
• Help evolve our Databricks and Azure data platform.
• Improve data quality, testing, observability and CI/CD.
• Partner with product and commercial teams to turn business opportunities into technical solutions.
• Mentor engineers and help shape our growing Data & AI capability.

Conhecimentos

Databricks

Python

PySpark

SQL

APIs

Data pipelines

Data models

Azure

LLMs / Generative AI

Communication

Ferramentas

Airbyte

Terraform

Descrição da oferta de emprego

Acuity Analytics is seeking a Senior Data Engineer to turn complex data into commercial, customer-facing products. You’ll work with Databricks, Azure, Python and PySpark to build scalable data solutions and explore AI capabilities.

In this hands-on role you’ll split time across engineering, mentoring and exploration, collaborating with product and commercial teams to bring ideas into production and accelerate value from data for customers.