Data Engineer – Analytics & ML Pipelines (Databricks, Hybrid)

Royal London Group; City of Edinburgh; Hybrid; GBP 65.000 - 90.000; Vollzeit

Zusammenfassung

Royal London Group is seeking an experienced Data Engineer to join the Analytics Engineering Team within our Group Data & AI Office. You will define, manage and deliver data, tools and pipelines to enable analytics, data science and machine learning projects across the organisation.

The role focuses on Databricks as the primary cloud platform, with heritage SQL Server pipelines, and requires collaboration with business areas, data scientists and engineers. Hybrid working: 50% home and 50% office.

Qualifikationen

• Advanced experience of cloud-based Data and Analytics platforms; Databricks knowledge is essential and Fabric/Snowflake experience is advantageous.
• Advanced experience in data engineering and application of data management design patterns.
• Experience creating Genie Agents, configuring data assets for Natural Language Querying and using Metric Views to create semantic layers.
• Proficient in SQL, Python and PySpark.
• Experience with development practices: GitHub, Azure DevOps or equivalents.
• Track record working in cross-functional projects and managing stakeholders.
• Broad understanding of BI/analytics tools such as PowerBI, Tableau and R.
• Knowledge of Microsoft SQL Server technologies e.g., T-SQL and SSIS.
• Understanding of analytics/data science tech including software engineering principles.

Aufgaben

• Source and prepare data for BI, Analytics, Data Science and Generative AI projects.
• Source, evaluate, interpret, model and manage multiple disparate data sources.
• Own and manage the team’s data, collaborating with business, technology and partners.
• Design, develop and deploy data pipelines in cloud platforms (Databricks) and migrate on-premises (SQL Server).
• Prototype solutions to test hypotheses in agile, iterative fashion.
• Productionise pipelines via CI/CD for BI, data science and visualization teams.
• Maintain knowledge of data engineering and ML practices and evolving technologies.
• Keep up-to-date on data-related technologies and best practices.
• Promote robust software engineering practices within the team.

Kenntnisse

SQL

Python

PySpark

Stakeholder management

Cross-functional collaboration

Tools

Databricks

Fabric

Snowflake

PowerBI

Tableau

R

T-SQL

SSIS

GitHub

Azure DevOps

Jobbeschreibung

Royal London Group is seeking an experienced Data Engineer to join the Analytics Engineering Team within our Group Data & AI Office. You will define, manage and deliver data, tools and pipelines to enable analytics, data science and machine learning projects across the organisation.

The role focuses on Databricks as the primary cloud platform, with heritage SQL Server pipelines, and requires collaboration with business areas, data scientists and engineers. Hybrid working: 50% home and 50% office.