Data Engineer

BJSS; Cardiff; On-site; GBP 40,000 - 60,000; Full time

Job summary

A data-focused technology company in Cardiff seeks a talented Data Engineer to build and optimize data applications and systems. You'll work in an agile environment, tackling complex data challenges with cutting-edge tools including AWS, Azure, and Databricks. You will need strong Python skills and experience with CI/CD processes. This role also includes various perks like flexible benefits, health plans, and professional growth opportunities, while promoting a collaborative workplace culture.

Benefits

Flexible benefits allowance

Industry leading health and wellbeing plan

Life Assurance (4 x annual salary)

25 days annual leave plus bank holidays

Hybrid working

Discounts on retail and lifestyle brands

Industry-leading referral scheme

Flexible holiday buy/sell option

Electric vehicle scheme

Training opportunities for professional certifications

Social calendar and team events

GymFlex gym membership programme

Qualifications

• Strong understanding of coding best practices and design patterns.
• Experience in writing well tested object-oriented Python.
• Understanding design choices for data storage and processing.

Responsibilities

• Build reliable and efficient data applications and services.
• Deploy data pipelines in a production-safe manner.
• Work within multi-disciplinary teams on modern data platforms.

Skills

Object-oriented Python

CI/CD tooling

Data storage solutions

Parallel computing

Complex queries (relational and non-relational)

Tools

AWS

Azure

GCP

Databricks

Data Factory

Job description

About the Role

We are DataOps advocates and use software engineering best practices to build scalable and re‑usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to do the straightforward things, they ask us to help on their biggest challenges which means we get to work with a wide range of tools and technologies and there are always new things to learn.

BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering with the knowledge and experience of building data solutions in order to deliver business value.

As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production‑safe manner, using the latest technologies and with a DataOps culture.

You’ll work in a fast moving, agile environment, within multi‑disciplinary teams of highly skilled consultants, delivering modern data platforms into large organisations.

You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc.

About You

• You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications systems, services and platforms.
• You have a good understanding of coding best practices and design patterns and experience with code and data versioning, dependency management, code quality and optimisation, error handling, logging, monitoring, validation and alerting.
• You have experience in writing well tested object‑oriented Python.
• You have experience with using CI/CD tooling to analyse, build, test and deploy your code.
• You have a good understanding of design choices for data storage and data processing, with a particular focus on cloud data services.
• You have experience in using parallel computing to process large datasets and to optimise computationally intensive tasks.
• You have experience in programmatically deploying, scheduling and monitoring components in a workflow.
• You have experience in writing complex queries against relational and non‑relational data stores.

Some of the Perks

• Flexible benefits allowance – you choose how to spend your allowance (additional pension contributions, healthcare, dental and more)
• Industry leading health and wellbeing plan - we partner with several wellbeing support functions to cater to each individual's need, including 24/7 GP services, mental health support, and other
• Life Assurance (4 x annual salary)
• 25 days annual leave plus bank holidays
• Hybrid working – Our roles are not fully remote as we take pride in the tight knit communities we have created at our local offices. But we offer plenty of flexibility and you can split your time between the office, client site and WFH
• Discounts – we have preferred rates from dozens of retail, lifestyle, and utility brands
• An industry‑leading referral scheme with no limits on the number of referrals
• Flexible holiday buy/sell option
• Electric vehicle scheme
• Training opportunities and incentives – we support professional certifications across engineering and non‑engineering roles, including unlimited access to O’Reilly
• Giving back – the ability to get involved nationally and regionally with partnerships to get people from diverse backgrounds into tech
• You will become part of a squad with people from different areas within the business who will help you grow at BJSS
• We have a busy social calendar that you can choose to join– quarterly town halls/squad nights out/weekends away with families included/office get togethers
• GymFlex gym membership programme