Data Engineer

BJSS; Lincoln; On-site; GBP 50,000 - 75,000; Full time

Job summary

A leading tech consultancy is seeking a Data Engineer to build and maintain data applications, leveraging cloud technologies like AWS and Azure. This role involves deploying data pipelines and collaborating within agile teams to address client challenges. The ideal candidate has strong coding skills in Python, a deep understanding of data processing, and experience in using CI/CD tooling. The position offers flexible working hours and various employee perks.

Benefits

Flexible benefits allowance

Industry-leading health plan

Life Assurance

25 days annual leave plus bank holidays

Hybrid working

Electric vehicle scheme

Training opportunities

Busy social calendar

Qualifications

• Experience in coding best practices and design patterns.
• Solid understanding of data versioning and validation.
• Experience in processing large datasets effectively.

Responsibilities

• Build, optimize, and maintain data applications and systems.
• Deploy data pipelines in a production-safe manner.
• Work with multi-disciplinary teams on data platform projects.

Skills

Object-oriented Python

CI/CD tooling

Data storage design

Parallel computing

Complex query writing

Tools

AWS

Azure

GCP

Databricks

Kafka

Job description

Social network you want to login/join with:

We are DataOps advocates and use software engineering best practices to build scalable and re-usable data solutions to help clients use their data to gain insights, drive decisions and deliver business value. Clients don’t engage BJSS to do the straightforward things, they ask us to help on their biggest challenges which means we get to work with a wide range of tools and technologies and there are always new things to learn.

BJSS data engineers are specialist software engineers that build, optimise and maintain data applications, systems and services. This role combines the discipline of software engineering with the knowledge and experience of building data solutions in order to deliver business value.

As a BJSS data engineer you’ll help our clients deploy data pipelines and processes in a production-safe manner, using the latest technologies and with a DataOps culture.

You’ll work in a fast moving, agile environment, within multi-disciplinary teams of highly skilled consultants, delivering modern data platforms into large organisations.

You can expect to get involved in variety of projects in the cloud (AWS, Azure, GCP), learning about and using data services such as Databricks, Data Factory, Synapse, Kafka, Redshift, Glue, Athena, BigQuery, S3, Cloud Data Fusion etc.

About You

• You're an engineer at heart and enjoy the challenge of building reliable, efficient data applications systems, services and platforms.
• You have a good understanding of coding best practices and design patterns and experience with code and data versioning, dependency management, code quality and optimisation, error handling, logging, monitoring, validation and alerting.
• You have experience in writing well tested object-oriented Python.
• You have experience with using CI/CD tooling to analyse, build, test and deploy your code.
• You have a good understanding of design choices for data storage and data processing, with a particular focus on cloud data services.
• You have experience in using parallel computing to process large datasets and to optimise computationally intensive tasks.
• You have experience in programmatically deploying, scheduling and monitoring components in a workflow.
• You have experience in writing complex queries against relational and non-relational data stores.

Some of the Perks

• Flexible benefits allowance – you choose how to spend your allowance (additional pension contributions, healthcare, dental and more)
• Industry leading health and wellbeing plan - we partner with several wellbeing support functions to cater to each individual's need, including 24/7 GP services, mental health support, and other
• Life Assurance (4 x annual salary)
• 25 days annual leave plus bank holidays
• Hybrid working - Our roles are not fully remote as we take pride in the tight knit communities we have created at our local offices. But we offer plenty of flexibility and you can split your time between the office, client site and WFH
• Discounts – we have preferred rates from dozens of retail, lifestyle, and utility brands
• An industry-leading referral scheme with no limits on the number of referrals
• Flexible holiday buy/sell option
• Electric vehicle scheme
• Training opportunities and incentives – we support professional certifications across engineering and non-engineering roles, including unlimited access to O’Reilly
• Giving back – the ability to get involved nationally and regionally with partnerships to get people from diverse backgrounds into tech
• You will become part of a squad with people from different areas within the business who will help you grow at BJSS
• We have a busy social calendar that you can chose to join– quarterly town halls/squad nights out/weekends away with families included/office get togethers