ML Engineer & Data Pipeline Specialist (Azure Databricks)

DBServices Portugal; Marco de Canaveses; Híbrido; EUR 45 000 - 65 000; Tempo integral

Resumo da oferta

DBServices Portugal is seeking a full-time Machine Learning Engineer/Data Engineer (MLE/DE) based in Marco de Canaveses. Candidates must be proficient in Python and Spark, with experience in creating data pipelines in an Azure Databricks environment.

The role involves working with popular machine learning practices, libraries, and tools like Airflow and MLOps. Familiarity with Agile methodologies and version control using Github is also necessary. Living in Portugal is a prerequisite for applicants.

Qualificações

• Proven experience as MLE or DE with hands-on expertise.
• Strong knowledge of creating data pipelines in Azure Databricks.
• Acquaintance with Agile methodologies and tools like Jira.

Responsabilidades

• Create data pipelines fueling machine learning models.
• Engage in software design patterns and RESTful APIs.
• Work with the main tech stack including Databricks and Spark.

Conhecimentos

Spark programming

Python programming

Databricks

MLOps

Github

Formação académica

BSc in Computer Science or a similar field

Ferramentas

Airflow

MLflow

Kafka

Delta Lake

Azure ADLS

Descrição da oferta de emprego

DBServices Portugal is seeking a full-time Machine Learning Engineer/Data Engineer (MLE/DE) based in Marco de Canaveses. Candidates must be proficient in Python and Spark, with experience in creating data pipelines in an Azure Databricks environment.

The role involves working with popular machine learning practices, libraries, and tools like Airflow and MLOps. Familiarity with Agile methodologies and version control using Github is also necessary. Living in Portugal is a prerequisite for applicants.