Data Engineering Consultant

Advancing Analytics; Remote; GBP 50,000 - 70,000; Full time

Job summary

A tech solutions firm in the UK is looking for a Data Engineering Consultant. This remote role requires a deep understanding of Python and SQL, with experience in Microsoft Azure and Apache Spark. Candidates should be dedicated, agile, and embrace sharing knowledge within a collaborative team. The position offers a salary between £50,000 to £70,000, depending on experience, along with a competitive benefits package including flexible working hours and health care benefits.

Benefits

Industry matching Maternity & Paternity policy

Private Medical & Dental Care

Health & Wellbeing fund

25 Days Annual Leave

Flexible Working Hours

Electric Car Scheme

Qualifications

• Working understanding of Microsoft Azure and cloud computing concepts.
• Experience with Apache Spark and technologies like Databricks.
• Python development skills as the primary language for solutions.

Responsibilities

• Build and improve analytical solutions for clients using core technologies.
• Participate in client consulting and requirements gathering.
• Work collaboratively within an agile team environment.

Skills

Requirements gathering and client consulting

Agile project management

Understanding of OO Development Practices

ETL Approaches – Data Quality, Resilience, Observability

Understanding of CI/CD Methodologies and SDLC

Tools

Microsoft Azure

Apache Spark

Python

SQL

Azure Data Factory

Azure Data Lake storage

Terraform

Power BI

Job description

Data Engineering Consultant

💸Salary: £50,000 to £70,000 (depending on experience)

📍Location: Remote – must be based within the UK. Occasional visits to see customers and the team.

🧠Interview process: Two rounds. 1: Get to know you chat with the People Recruitment Manager; 2: Technical competency with the Hiring Lead and a Team Member.

🤝Our Values: Advancing, Come as you are, Zero burnout, Greta goal, We all level up together and Transparency

Learn more about us: YouTube, Totally Skewed Podcast & Data Science in Production. Read our Blogs.

Who Are We?

Advancing Analytics are a market leader in delivering bleeding edge analytical solutions for customers all over the world. To thrive in today's market, businesses need to implement AI built on a solid, reliable Data Platform, and we are looking for you to help us build it!

Who are we looking for?

Dedicated individuals who blend technical passion with the honesty and empathy needed for client consulting. People who love data and strongly believe in sharing knowledge, skills and wisdom both internally and with the wider data community. Someone who thrives in an agile environment, balancing their technical prowess with the pragmatic needs of the project. For the consultant role, we expect a good working knowledge of our core tech stack.

Required Tools and Technologies:

• Microsoft Azure and cloud computing concepts
• Apache Spark – Databricks, Microsoft Fabric or another Spark engine
• Python – we build most of our solutions in Python
• SQL – writing complex high-performance queries, understanding how queries execute on different compute technologies
• Azure Data Factory or other cloud orchestration tools
• Azure Data Lake storage and Delta Lake
• Unity Catalog, Purview or other Data Governance tools
• Infrastructure as Code tools such as Terraform, Azure DevOps

Other technology we like, but isn’t essential:

• Visualisation Tools – Power BI, Tableau
• Streaming Data – Azure Stream Analytics, Event Hubs, IoT Hubs
• Building parallel systems – Distributed compute engines
• Azure Functions – Python, C#

Skills and Approaches:

• Requirements gathering and client consulting
• Agile project management
• Understanding of OO Development Practices
• ETL Approaches – Data Quality, Resilience, Observability
• Understanding of CI/CD Methodologies and SDLC

What will it be like to work for Advancing Analytics?

We are a small company and encourage everyone to have a voice within our collaborative and inclusive team from day one.

As a Microsoft Gold Partner, Databricks Partner, AWS and GCP partner, you will have access to the latest tech and training opportunities the industry has to offer. We are aware this is a rapidly changing market and are committed to investing in the long-term goals of our employees. We love being engaged in the wider tech community and frequently present at events, sponsor events such as Big Data London, SQLBits and even organise the Global AI Bootcamp London.

We encourage our team to get involved in the community, whether that’s in the form of a personal blog, or an initiative you are passionate about advocating, we will support you!

Aside from offering a competitive salary, we have a great set of benefits and perks including, but not limited to:

• Industry matching Maternity & Paternity policy
• Private Medical & Dental Care plus Eye care schemes
• Health & Wellbeing fund
• 25 Days Annual Leave, Birthday Leave & Charity Leave
• Frequent away days with the team
• Flexible Working Hours
• Electric Car Scheme

Our company values define us:

• Advancing – the projects that get us all out of bed are challenging and push the limits of what is currently possible. We work on the bleeding edge and challenge the analytical industry daily.
• Come as you are – we are an inclusive company. When you work with us, rest assured you're working in a safe environment.❤️
• Zero burnout – too often technology teams are worked too hard or stretched too thin. We have seen it happen and we never want to be a company that pushes our staff to breaking point.
• Greta Goal – we only have one planet, let’s look after it.🌎
• We all level up together – we have each seen the benefit that being part of a developer community can have, it is transformational. We invest in our communities, you will find us organising meetups, conferences, and events. When we are not organising, we are helping, speaking, mentoring, or sponsoring.🔼
• Transparency – We are big believers that there are no secrets in Advancing Analytics, and we try to live this day to day.

You can read about our values in more detail here - https://www.advancinganalytics.co.uk/values