Machine Learning Engineer | Data Engineer

DBServices Portugal; Marco de Canaveses; Presencial; EUR 45 000 - 65 000; Tempo integral

Resumo da oferta

DBServices Portugal is seeking a full-time Machine Learning Engineer/Data Engineer (MLE/DE) based in Marco de Canaveses. Candidates must be proficient in Python and Spark, with experience in creating data pipelines in an Azure Databricks environment.

The role involves working with popular machine learning practices, libraries, and tools like Airflow and MLOps. Familiarity with Agile methodologies and version control using Github is also necessary. Living in Portugal is a prerequisite for applicants.

Qualificações

• Proven experience as MLE or DE with hands-on expertise.
• Strong knowledge of creating data pipelines in Azure Databricks.
• Acquaintance with Agile methodologies and tools like Jira.

Responsabilidades

• Create data pipelines fueling machine learning models.
• Engage in software design patterns and RESTful APIs.
• Work with the main tech stack including Databricks and Spark.

Conhecimentos

Spark programming

Python programming

Databricks

MLOps

Github

Formação académica

BSc in Computer Science or a similar field

Ferramentas

Airflow

MLflow

Kafka

Delta Lake

Azure ADLS

Descrição da oferta de emprego

• Full-time

Job Description

Proven experience as MLE/DE.

BSc in Computer Science or a similar field, with a very solid Spark and Python programming experience; Scala is a plus - for creating data pipelines that will fuel machine learning models in an Azure Databricks based environment.

Proven experience with the engineering aspects of popular machine learning practices, libraries, and platforms - such as the ones that allow serving and productionasing machine learning models.

Acquaintance with CD4ML and MLOps, software design patterns and RESTful APIs.

Main tech stack: Databricks, Spark, Airflow, MLflow, MLeap, Kafka, Delta Lake and Azure ADLS (Parquet, Avro), Azure Devops.

Proficient in code versioning tools: Github.

Comfortable with an Agile methologies (Scrum, Kanban) using Jira Agile.

Out of Scope

• Front-end development.
• Data Science, in the way that he will not research, apply, create and train statistical / math / machine learning models.
• Apply advanced Machine Learning (e.g. NLP, CV, Mathematical Optimization).

Additional Information

• Necessary to live in Portugal.