Data engineer in consumer analytics

Curve Analytics; Greater London; Hybrid; GBP 75,000 - 115,000; Full time

Benefits offered by this job

25 days holiday

8% pension contribution

Private healthcare

Cycle to Work Scheme

Employee Assistance Programme

Personal Growth Plan

Annual learning budget

London HQ hybrid

Job summary

Curve Analytics in London seeks a data engineering specialist to build innovative data solutions using Python, PySpark, SQL across Databricks, Snowflake, AWS and more. You will support global analytics programmes, design data models and deploy automated pipelines.

You will work with project leads, data scientists and client tech teams, improving data reliability and documenting thoroughly while helping productionise ML models and APIs from major providers.

Qualifications

• Bachelor’s degree in an applicable field such as Computer Science, Statistics, Maths or similar.
• Experience designing, building and maintaining SQL databases (and/or NoSQL).
• Experience with designing efficient physical data models/schemas and developing ETL/ELT scripts.
• Strong python and other programming skills (Java and/or Scala desirable).
• Experience in cloud environments (Azure, AWS or GCP) with Databricks & Snowflake a bonus.
• Strong SQL background; exposure to big data technologies (Hadoop, Spark, Presto).
• Nice-to-have: APIs, Data Science/NLP, DevOps, social listening tools.

Responsibilities

• Build innovative data solutions in Python, PySpark & SQL across Databricks, Snowflake, AWS and more.
• Support the development and rollout of industry first global analytics programmes.
• Develop and deploy automated code pipelines, from data acquisition, owning transformation and supporting data modelling.
• Help to productionise machine learning models and integrate APIs from OpenAI, GCP, Microsoft and other open source solutions.
• Work closely with programme teams - project lead, data scientists and analysts – and interface with client technology counterparts.
• Identify ways to improve data reliability, processing efficiency and quality of our data output.
• Produce detailed documentation and champion code quality.
• Interrogate rich data sources such as social, search, surveys, reviews, clickstream, sales and more.

Skills

Python

Java/Scala

SQL

ETL/ELT

Big data concepts

Education

Bachelor’s degree in Computer Science / Statistics / Maths / Engineering

Tools

Databricks

Snowflake

AWS

Azure

GCP

Hadoop

Spark

Presto

Job description

Описание

Curve is a next-gen insights, analytics and technology consultancy that leverages digital consumer data and advanced technology to help businesses unlock consumer opportunities. Digital consumer data is powerful; it's big, it's real, and it's always updating.

Задачи

• Build innovative data solutions in Python, PySpark & SQL across Databricks, Snowflake, AWS and more
• Support the development and rollout of industry first global analytics programmes
• Develop and deploy automated code pipelines, from data acquisition, owning transformation and supporting data modelling
• Help to productionise machine learning models and integrate leading APIs from OpenAI, GCP, Microsoft and other open source solutions
• Work closely with great programme teams - project lead, data scientists and analysts – and interface with client technology counterparts
• Identify ways to improve data reliability, processing efficiency and quality of our data output
• Produce detailed documentation and champion code quality
• Interrogate rich data sources such as social, search, surveys, reviews, clickstream, sales, connected devices and beyond
• Identify and explore opportunities to acquire new data sources that deliver innovative perspectives to our clients

Требования

• Bachelor’s degree or higher in an applicable field such as Computer Science, Statistics, Maths or similar Science or Engineering discipline
• Experience designing, building and maintaining SQL databases (and/or NoSQL)
• Experience with designing efficient physical data models/schemas and developing ETL/ELT scripts
• Strong python and other programming skills (Java and/or Scala desirable)
• Experience developing data solutions in cloud environments such as Azure, AWS or GCP – Azure Databricks & Snowflake experience a bonus
• Strong SQL background
• Some exposure to big data technologies (hadoop, spark, presto, etc.)
• Будет плюсом: Experience with APIs; Experience with Data Science and / or NLP; Data & Solution Architecture understanding; Experience of software development, CI/CD pipelines and/or other DevOps practices and principles; Experience utilising social listening tools and / or search / web analytics tools

Условия

• We offer a competitive salary, that reflects your talent and expertise in accordance with industry standards.
• 25 days holiday a year plus bank holidays.
• Our Annual Bonus is based on company and individual performance.
• You can expect to receive a generous 8% employers’ pension contribution.
• Access our Cycle to Work Scheme and prioritise your health with our comprehensive AXA Private Healthcare Plan and 24/7 Employee Assistance Programme.
• You will also be assigned a dedicated People Manager for confidential discussions about your work life.
• Split your time between working remotely and from our London HQ.
• You will be able to create a Personalised Growth Plan and get involved in our internal trainings.
• You will also get a yearly individual learning budget for training, books, courses, certifications, and conferences.
• Be part of a dynamic company culture with frequent team activities, company events and socials that foster a strong sense of community among our diverse team.