Senior Data Engineer — AI, Databricks & Cloud Data Pipelines

Arla Foods; Denmark; On-site; DKK 800,000 - 1,400,000; Full time

Job summary

Arla Foods is seeking a Senior IT Developer to join Commercial IT Product, focusing on Innovation and Consumer Intelligence. You will help build data-driven solutions that enable better insights, decisions and business outcomes, collaborating with stakeholders to translate needs into scalable technical solutions.

You will work with Azure Databricks, Power BI and Microsoft Foundry, developing in PySpark and SQL, and deploying via Terraform with version control in Azure DevOps or GitHub.

Qualifications

• Degree in information systems, computer science, engineering or similar.
• 3-5 years of experience as Data Warehouse Developer, BI Developer, SQL Developer or Data Engineer.
• Ability to translate business needs into practical technical solutions.
• Experience developing with Spark in Databricks.
• Proficient in SQL and PySpark.
• Proficient in ETL/ELT/Integration/Workflow/Task Automation tools (e.g. Azure Data Factory, Logic Apps, Azure Function, SSIS).
• Knowledge of data engineering best practices and scalable lakehouse design.
• Proactive and eager to learn AI technologies.

Responsibilities

• Collaborate with business stakeholders to translate requirements into technical solutions.
• Develop and maintain data pipelines, data models and digital solutions that support business needs.
• Build scalable ETL/ELT processes and contribute to high-quality data engineering practices.
• Support the continuous improvement of existing solutions and development processes.
• Work closely with developers, architects, IT specialists and business stakeholders to deliver reliable and maintainable solutions.
• Contribute to the development of modern cloud-based data platforms and applications.

Skills

SQL

PySpark

Data Modeling

ETL/ELT

Azure Databricks

Power BI

Generative AI

LLMs

Vector Databases

Cloud (Azure)

Terraform

GitHub

Education

Bachelor’s degree in Information Systems, Computer Science, Engineering or similar

Tools

Azure Data Factory

Logic Apps

Azure Function

SSIS

Terraform

GitHub

Databricks

Power BI

Job description

Arla Foods is seeking a Senior IT Developer to join Commercial IT Product, focusing on Innovation and Consumer Intelligence. You will help build data-driven solutions that enable better insights, decisions and business outcomes, collaborating with stakeholders to translate needs into scalable technical solutions.

You will work with Azure Databricks, Power BI and Microsoft Foundry, developing in PySpark and SQL, and deploying via Terraform with version control in Azure DevOps or GitHub.