Data Engineer (Ref: 197753)

Forsyth Barnes; Deutschland; Hybrid; EUR 70.000 - 110.000; Vollzeit

Zusammenfassung

Forsyth Barnes is partnering with a leading FMCG company in Germany to scale its data and analytics team.

The hands-on role designs, builds and optimises data platforms enabling financial and operational insights across the business.

Qualifikationen

• At least 5 years' experience across data engineering, data analytics and/or BI.
• Proficiency in Python and SQL.
• Excellent knowledge of Microsoft Fabric and Power BI Service.
• Experience building data pipelines within Azure, including ADF, Synapse and Fabric.
• Strong understanding of Spark.
• Experience with complex, imperfect datasets.
• Experience delivering tech projects in fast-paced organisations.
• Knowledge of version control, CI/CD and Terraform.

Aufgaben

• Design, build and operate ELT/ETL data pipelines using Microsoft Fabric.
• Develop data solutions within a Medallion Architecture and optimise SQL queries for reporting.
• Integrate data from multiple internal and external sources.
• Manage and optimise lakehouses, warehouses and storage.
• Implement data quality, testing and observability processes.
• Support data lineage and enable self-service analytics through documented data models.
• Monitor performance and proactively improve data infrastructure.
• Troubleshoot incidents and deploy fixes.
• Contribute to CI/CD practices and engineering standards.
• Collaborate with IT and the business to deliver fit-for-purpose data solutions.

Kenntnisse

Python

SQL

Microsoft Fabric

Power BI Service

Azure

ADF

Synapse

Spark

CI/CD

Terraform

MDM

Azure DevOps

Tools

Azure DevOps

CI/CD

Terraform

Jobbeschreibung

About Us

Forsyth Barnes have partnered with a leading FMCG company based in Cambridgeshire to scale their data and analytics team

Job Description

ReportingtotheDataManager,you’llhelpdesign,buildandimprovethedataplatformsand infrastructure that support financial and operational insight across the business.

Thisisahands-onrolewhereyou’llworkwithdatafrommultiplesystemsandsources,often with varying levels of structure, consistency and quality. Using technologies including MicrosoftFabric,Azure,Python,SQLandPowerBI,you’llbuildreliable,scalableand maintainable data solutions.

You’ll be involved in significant technology and transformation projects, developing and enhancingdatapipelines,integratingnewdatasources,troubleshootingtechnicalissuesand improving the performance and reliability of existing solutions.

Ifyouenjoysolvingproblems,workingwithmodernclouddatatechnologiesandseeingthe direct impact of your work within a fast-moving business, this is a fantastic opportunity to make a real difference.

Key Responsibilities

• Design, build and operate ELT/ETL data pipelines using Microsoft Fabric
• Design and develop data solutions within a Medallion Architecture (Bronze, Silver and Gold) Develop, optimise and maintain complex SQL queries to support reporting and analytics
• Integrate data from a variety of internal and external sources
• Manage and optimise lakehouses, warehouses and associated storage
• Implement data quality, testing and observability processes to ensure data is accurate, reliable and compliant
• Support data lineage and ensure stakeholders can trust the information available to them
• Enable self-service analytics through well-documented data models and transformation logic
• Monitor performance and proactively identify opportunities to improve our data infrastructure
• Troubleshoot incidents, complete root-cause analysis and deploy effective fixes
• Contribute to CI/CD practices, documentation and engineering standards
• Work closely with colleagues across IT and the wider business to deliver fit-for-purpose data solutions
• Continuously look for opportunities to improve our technology, processes and ways of working

Requirements

• At least 5 years' experience across data engineering, data analytics and/or Business Intelligence
• Proficiency in Python and SQL
• Excellent knowledge of Microsoft Fabric and Power BI Service
• Experience building and operating data pipelines within Azure, including technologies such as ADF, Synapse and Fabric
• Strong understanding of Spark
• Experience working with complex and imperfect datasets
• Experience delivering technology projects within a fast-paced organisation
• Knowledge of version control, Azure DevOps and CI/CD best practices
• Understanding of Infrastructure-as-Code tools such as Terraform
• Knowledge of identity and secrets management and cloud cost optimisation
• Understanding of information management principles, processes and Master Data Management (MDM)
• Experience delivering solutions within appropriate development frameworks and methodologies, with consideration for ongoing supportability