Hybrid Data Platform Engineer — Azure & Databricks

Amplius; Peterborough; Hybrid; GBP 50,000 - 61,000; Full time

Job summary

Amplius is seeking a Data Platform Engineer to design, build and operate secure, cost-efficient data pipelines using Azure and Databricks. You will ingest data from diverse sources, ensure quality and governance, and collaborate with data product, BI and IT teams.

The role is hybrid with weekly office presence in Milton Keynes, Rushden, Peterborough or Boston, UK, offering £55,000 per year and a 36.25-hour week. Right to work in the UK required.

Qualifications

• Degree in Computer Science, Data/Software Engineering or equivalent.
• Proficiency in SQL, Python and Scala for data processing.
• Experience designing and deploying ETL/ELT pipelines on Azure Databricks.

Responsibilities

• Design, build and operate secure, reliable and cost-effective data pipelines using Azure services and Databricks.
• Ingest and transform data from different sources, handling changes in data and schemas effectively.
• Improve pipeline performance, reliability and cost, while automating tasks and maintaining clear technical documentation.
• Build data quality checks, validation and reconciliation, and contribute to metadata, data lineage and governance requirements.
• Use Git, code reviews, CI/CD and IaC to deliver safe, repeatable changes, supported by monitoring and deployment evidence.
• Work with Data Product Engineers, BI & Reporting, IT Solution Architects, Data Governance, Cyber and DPO teams.

Skills

SQL

Python

Scala

Education

Degree in Computer Science / Data Engineering or equivalent

Tools

Databricks

Azure Data Factory

Azure Synapse Analytics

Job description

Amplius is seeking a Data Platform Engineer to design, build and operate secure, cost-efficient data pipelines using Azure and Databricks. You will ingest data from diverse sources, ensure quality and governance, and collaborate with data product, BI and IT teams.

The role is hybrid with weekly office presence in Milton Keynes, Rushden, Peterborough or Boston, UK, offering £55,000 per year and a 36.25-hour week. Right to work in the UK required.