Senior Data Engineer AI - Portugal

Codurance; Portugal; Teletrabalho; EUR 70 000 - 90 000; Tempo integral

Resumo da oferta

Codurance is seeking a Senior Data Engineer to join our software delivery teams and help clients build production-grade data foundations using Databricks, Delta Lake, and Spark/PySpark. You will ensure robust, well-crafted data systems with rigorous software practices.

You will collaborate across engineering teams, implement data quality, orchestration, monitoring, and lineage, and mentor others. AWS or Azure experience is preferred.

Qualificações

• Hands-on Databricks in production is required.
• Strong Python development and testing practices.
• Experience with CI/CD, Git, and deployment processes.
• Experience building reliable data pipelines with quality, lineage, and schema evolution.
• Experience with client delivery and cross-team collaboration.
• Cloud experience with AWS or Azure preferred.

Responsabilidades

• Design and operate production-grade data pipelines on Databricks.
• Collaborate with client delivery teams across modernization projects.
• Mentor junior engineers and contribute to best practices.
• Ensure data quality, monitoring, and lineage across data platforms.

Conhecimentos

Python

Databricks

Data engineering

CI/CD

Git

Testing

Code review

Deployment

Infrastructure as Code

Consulting

Ferramentas

Databricks

Delta Lake

Spark/PySpark

Unity Catalog

CI/CD pipelines

Git

IaC tools

Descrição da oferta de emprego

We are looking for a Senior Data Engineer who shares our values of software craftsmanship, pragmatism, professionalism. You understand that data engineering is, at its core, great software engineering, applied at scale, with rigour, and with production in mind.

This is not a standalone data role. You will work as part of our software delivery teams, helping clients build production-grade data foundations in broader modernisation, platform, data, and AI-readiness engagements. Databricks is our primary data engineering platform, and you will be expected to use it fluently; but the goal is always durable, well-crafted data systems, not tool advocacy.

Current or recent experience:

Data Engineer, Senior Data Engineer, Data Platform Engineer, or Databricks Engineer role.

Essential – Databricks in production

Hands‑on experience with Databricks in production, including Delta Lake, Spark/PySpark, Unity Catalog, or production lakehouse projects.

Essential – Strong software engineering practices

Strong experience with Python, testing, Git, CI/CD, code review, deployment, or Infrastructure as Code.

Essential – Builds and operates reliable pipelines

Experience with data quality, orchestration, monitoring, lineage, schema evolution, or data contracts.

Essential – Consulting and collaboration

Experience with client delivery, stakeholder engagement, modernisation projects, mentoring, or working across engineering teams.

Preferred – Cloud

Experience with AWS or Azure.
Either cloud is acceptable for the role.

Differentiator – Data for production ML/AI

Experience with ML/AI feature pipelines, MLflow, model lineage, embeddings, vector search, retrieval, or evaluation datasets.