Data & GenAI Platform Lead - Azure & Databricks

Decskill; Portugal; Presencial; EUR 70 000 - 110 000; Tempo integral

Resumo da oferta

Decskill is seeking a Data Technical Lead to drive data-driven initiatives across Lisbon, Porto, and international contexts. You will design, implement, and optimize Python and PySpark apps, build data pipelines in Databricks, and shape ML workflows on Azure data platforms.

You will also develop GenAI solutions using OpenAI APIs, LangChain, LangGraph, and RAG architectures, plus REST APIs, collaborating with agile teams globally to deliver high-quality software responsibly.

Qualificações

• Bachelor's degree in Software Engineering, Computer Science, Computer Engineering, or related field.
• Hands-on experience with Python, PySpark, Databricks, and software development best practices.
• Solid experience with Microsoft Azure, including Azure Data Factory, cloud-based data pipelines, and ML workflows.
• Experience developing and maintaining ML models (regression, classification, lifecycle management).
• Practical experience with Generative AI (OpenAI APIs, LangChain, LangGraph, RAG architectures, vector databases, Langfuse observability).
• Experience with PostgreSQL, SQL, data modeling, and vector databases.
• Experience developing and maintaining REST APIs.
• Knowledge of DevOps, CI/CD, GitHub, environment management, automated testing (pytest), and code quality tools (SonarQube).
• Technical documentation, troubleshooting, log analysis, and governance.
• Strong analytical and problem-solving skills; excellent communication.
• Experience in Agile environments; knowledge of Jira and Confluence is a plus.
• Fluent English; Portuguese/Spanish is advantageous.

Responsabilidades

• Develop, maintain, refactor, and optimize Python and PySpark applications.
• Build and maintain data pipelines and ML workflows using Databricks and Azure Data Factory.
• Develop, deploy, and support GenAI solutions using OpenAI APIs, LangChain, LangGraph, and RAG architectures.
• Design and maintain AI solutions, including document indexing and vector databases integration.
• Develop and maintain REST APIs and integrate with internal/external systems.
• Manage deployment of applications, data pipelines, and ML models across environments.
• Perform code reviews, automated testing, troubleshooting, log analysis, and improve code quality with GitHub, pytest and SonarQube.
• Maintain technical documentation, manage debt backlog, support infra changes, ensure governance.

Conhecimentos

Python

PySpark

Databricks

Azure

Azure Data Factory

Machine Learning

REST APIs

SQL

PostgreSQL

CI/CD

GitHub

pytest

SonarQube

OpenAI APIs

LangChain

LangGraph

RAG architectures

Langfuse observability

JIRA

Confluence

English fluency

Formação académica

Bachelor's degree in Software Engineering

Ferramentas

Databricks

Azure Data Factory

GitHub

pytest

SonarQube

LangChain

LangGraph

Langfuse

Descrição da oferta de emprego

Decskill is seeking a Data Technical Lead to drive data-driven initiatives across Lisbon, Porto, and international contexts. You will design, implement, and optimize Python and PySpark apps, build data pipelines in Databricks, and shape ML workflows on Azure data platforms.

You will also develop GenAI solutions using OpenAI APIs, LangChain, LangGraph, and RAG architectures, plus REST APIs, collaborating with agile teams globally to deliver high-quality software responsibly.