Data Analytics Engineer

Intec Select Ltd; England; Hybrid; GBP 59,000 - 70,000; Full time

Job summary

A leading data solution provider is seeking a skilled Data Analytics Engineer to enhance their clients' data platforms. The role involves designing scalable data solutions using Azure Databricks and Apache Spark, developing data workflows, and collaborating across teams. Ideal candidates will have experience in data engineering and related technologies. A competitive salary up to £70,000 plus excellent package is offered.

Qualifications

• Proven experience with Azure Databricks and Apache Spark.
• Strong proficiency in SQL and Python.
• Working knowledge of Apache Kafka and real-time data streaming.

Responsibilities

• Design and build scalable data pipelines using Apache Spark.
• Develop real-time and batch data ingestion workflows using Apache Kafka.
• Collaborate with data scientists and analysts to build high-quality data products.
• Support the deployment of machine learning pipelines.

Skills

Data engineering

SQL

Python

Cloud technologies

Problem-solving skills

Tools

Azure Databricks

Apache Kafka

Apache Spark

Power BI

Job description

Overview

We\'re looking for a skilled Data Analytics Engineer to help drive the evolution of our clients data platform. This role is ideal for someone who thrives on building scalable data solutions and is confident working with modern tools such as Azure Databricks, Apache Kafka, and Spark. In this role, you\'ll play a key part in designing, delivering, and optimising data pipelines and architectures. Your focus will be on enabling robust data ingestion and transformation to support both operational and analytical use cases. If you\'re passionate about data engineering and want to make a meaningful impact in a collaborative, fast-paced environment, we want to hear from you

• Permanent
• Basingstoke (Hybrid - x2 PW)
• Up to 70,000 + Excellent Package

Role and Responsibilities

• Designing and building scalable data pipelines using Apache Spark in Azure Databricks
• Developing real-time and batch data ingestion workflows, ideally using Apache Kafka
• Collaborating with data scientists, analysts, and business stakeholders to build high-quality data products
• Supporting the deployment and productionisation of machine learning pipelines
• Contributing to the ongoing development of a Lakehouse architecture
• Working in an Agile/DevOps environment to continuously improve platform performance and reliability

Essential Skills and Experience

• Proven experience with Azure Databricks and Apache Spark
• Working knowledge of Apache Kafka and real-time data streaming
• Strong proficiency in SQL and Python
• Familiarity with Azure Data Services and CI/CD pipelines in a DevOps environment
• Solid understanding of data modelling techniques (e.g., Star Schema)
• Excellent problem-solving skills and a high attention to detail

Desirable

• Azure Data Engineer certification
• Experience working with unstructured data sources (e.g. voice)
• Exposure to Power BI for downstream reporting (desirable, but secondary to platform engineering skills)
• Previous experience in regulated industries