Senior Data Engineer for AI Production Pipelines

Codurance; Portugal; Teletrabalho; EUR 70 000 - 90 000; Tempo integral

Resumo da oferta

Codurance is seeking a Senior Data Engineer to join our software delivery teams and help clients build production-grade data foundations using Databricks, Delta Lake, and Spark/PySpark. You will ensure robust, well-crafted data systems with rigorous software practices.

You will collaborate across engineering teams, implement data quality, orchestration, monitoring, and lineage, and mentor others. AWS or Azure experience is preferred.

Qualificações

• Hands-on Databricks in production is required.
• Strong Python development and testing practices.
• Experience with CI/CD, Git, and deployment processes.
• Experience building reliable data pipelines with quality, lineage, and schema evolution.
• Experience with client delivery and cross-team collaboration.
• Cloud experience with AWS or Azure preferred.

Responsabilidades

• Design and operate production-grade data pipelines on Databricks.
• Collaborate with client delivery teams across modernization projects.
• Mentor junior engineers and contribute to best practices.
• Ensure data quality, monitoring, and lineage across data platforms.

Conhecimentos

Python

Databricks

Data engineering

CI/CD

Git

Testing

Code review

Deployment

Infrastructure as Code

Consulting

Ferramentas

Databricks

Delta Lake

Spark/PySpark

Unity Catalog

CI/CD pipelines

Git

IaC tools

Descrição da oferta de emprego

Codurance is seeking a Senior Data Engineer to join our software delivery teams and help clients build production-grade data foundations using Databricks, Delta Lake, and Spark/PySpark. You will ensure robust, well-crafted data systems with rigorous software practices.

You will collaborate across engineering teams, implement data quality, orchestration, monitoring, and lineage, and mentor others. AWS or Azure experience is preferred.