Data Engineer

Vallum Associates; Sheffield; On-site; GBP 65,000 - 90,000; Full time

Job summary

Vallum Associates in the United Kingdom is seeking a talented data engineer to join our data platform team. You will own end-to-end data solutions, from sourcing and ingestion to the data warehouse, enabling analytics across the business.

The ideal candidate has strong SQL, Python, and experience with cloud data tooling (GCP/BigQuery), data governance, metadata and lineage, and agile delivery using JIRA and Confluence.

Qualifications

• Hands-on experience delivering end-to-end data solutions (data sourcing, ingestion, warehouse patterns).
• Strong SQL and relational data modelling experience.
• Proficiency in Python with solid software engineering practices.
• Experience with data governance, metadata, lineage and access controls.
• Agile delivery familiarity with JIRA/Confluence.

Skills

SQL

Python programming

Data modelling

Communication skills

Tools

Google Cloud Platform (GCP) / BigQuery

JIRA

Confluence

Job description

• Strong understanding of Operational Resilience concepts and hands-on experience with relevant data e.g. service / impact tolerances, asset dependency incidents / outages, DR / BCP test evidence, concentration indicators
• Conceptual understanding of Procurement / Real Estate and associated data domains preferred
• Demonstrable understanding of graph concepts (nodes / edges, typed relationships, multi-hop traversal / path analysis) and ability to apply in the context of Operational Resilience e.g. what-if analysis, identifying critical path / single point of failure
• Demonstrable experience in a data engineering role delivering end-to-end data solutions (data sourcing, ingestion, data warehouse / refinery patterns, data asset delivery)
• Strong SQL skills and experience with relational data modelling and optimisation
• Hands-on experience with cloud data tooling and services (e.g. Google Cloud Platform, including BigQuery or equivalent)
• Strong coding capability in Python with solid software engineering practices (version control, testing, CI/CD where applicable)
• Experience with enterprise data technologies and platforms commonly used in large organisations and data integration patterns Template version: March 2020 ( when complete)
• Experience with data governance and operating discipline, metadata, lineage, access controls, retention, and data standards
• Experience with Agile delivery and familiarity with relevant tools (JIRA and Confluence).
• Strong written and verbal communication skills, including ability to work effectively with technical and nontechnical stakeholders