Staff Data Engineer - End-to-End, Hands-On Data Platforms

Ocho People Ltd.; Belfast City District; Remoto; GBP 99.000 - 121.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid work model

Hands-on data engineering

Descrizione del lavoro

Ocho People is recruiting a Staff Data Engineer in Belfast for a genuinely hands-on, production-focused role. You will own and ship distributed data pipelines end-to-end, working with Spark, Kafka, dbt and modern cloud stacks to scale platforms used by leading consumer brands.

You’ll design and optimise data systems, balance architectural decisions with real-world delivery, and mentor peers while remaining hands-on. The role offers flexible hybrid working and a path to technical leadership.

Competenze

• 7+ years designing and building robust, distributed data systems in production.
• Hands-on Spark and distributed processing at scale.
• Experience with a modern data stack: dbt, SQL, Athena/Trino, Redshift or Snowflake, and RDBMSs such as PostgreSQL or MySQL.
• Experience with data orchestration tools such as Apache Airflow or Dagster.
• Knowledge of event-driven architectures and streaming technologies such as Apache Kafka, Kafka Streams or Apache Flink.
• Experience with public cloud environments (AWS, GCP or Azure) and infrastructure as code such as Terraform.
• Strong software engineering practice: testing, CI/CD (Jenkins or GitHub Actions), git/version control, containers.
• BSc in Computer Science or a related discipline

Mansioni

• Design, build and personally ship large-scale, distributed data pipelines and platforms, not just target architectures or recommendations.
• Own the full lifecycle end to end: requirements, architecture, implementation, deployment and ongoing optimisation.
• Make and defend real technical trade-off decisions: which database, which file format, which orchestration tool, batch versus streaming, and why.
• Build and operate distributed data processing with Spark, working directly with how it behaves under real load, not just listing it as a skill.
• Apply modern judgement to data modelling, knowing when dimensional and star modelling still earns its place and when a modern platform changes the rules.
• Optimise for query performance, partitioning, indexing and cost as data volumes and complexity grow.
• Embed strong software engineering practice into data work: testing, CI/CD, version control and containerisation.
• Collaborate with cross-functional teams to translate real business and product requirements into production-grade systems.
• Troubleshoot and resolve issues directly in live, large-scale data systems.
• Mentor others on the team while staying hands-on yourself, an architect who still builds

Conoscenze

Spark

dbt

SQL

Airflow

Dagster

Kafka

Flink

AWS

GCP

Azure

Terraform

CI/CD

Testing

Git

Containers

Formazione

BSc in Computer Science

Strumenti

Athena/Trino

Redshift

Snowflake

PostgreSQL

MySQL

GitHub Actions

Descrizione del lavoro

Ocho People is recruiting a Staff Data Engineer in Belfast for a genuinely hands-on, production-focused role. You will own and ship distributed data pipelines end-to-end, working with Spark, Kafka, dbt and modern cloud stacks to scale platforms used by leading consumer brands.

You’ll design and optimise data systems, balance architectural decisions with real-world delivery, and mentor peers while remaining hands-on. The role offers flexible hybrid working and a path to technical leadership.