Senior Data Engineer

Ipsos; London; On-site; GBP 50,000 - 70,000; Full time

Job summary

Ipsos is seeking a Data Engineer to join their Audience Measurement team in London. This role involves developing robust data pipelines for a groundbreaking synthetic travel survey. The successful candidate will work closely with data scientists, ensuring high-quality audience data through collaboration and technical expertise, while contributing to innovative data solutions.

Benefits

25 days annual leave

Pension scheme

Flexible benefits

Private healthcare for select roles

Qualifications

• 3+ years of experience in data engineering and working with scalable data pipelines.
• Expertise in GCP, Python libraries like Pandas, and APIs.
• Experience with CI/CD processes and data system optimization.

Responsibilities

• Develop and maintain data pipelines for audience measurement.
• Collaborate with data scientists to optimize data flows.
• Implement ETL processes to ensure data integrity and quality.

Skills

Data pipeline development

Data quality assurance

Collaboration

Communication

Cloud storage systems

Education

Bachelor’s degree in Computer Science or related field

GCP certifications

Tools

GCP

Docker

Kubernetes

Terraform

SQL

Python

Job description

Job Description

Role Overview:

The Audience Measurement team at Ipsos use deep understanding of people to make sense of audiences and how they consume media. We use these to influence media strategy, helping clients to answer crucial questions, such as how to target audiences, maximise attention across platforms, enhance audience experience, and demonstrate or increase audience value.

We are recruiting a Data Engineer for one of our flagship accounts, Out Of Home - Route.

Your work will be essential for the Route project's success. Building robust and scalable infrastructure and being the linchpin between the data platform and data science teams in an 'advisory-like' role will enable data scientists to focus on research and innovation in synthetic data, enhancing data-driven solutions for clients and Ipsos. You will often support the productionisation and scaling of local ML models, guiding the data science teams and providing the guardrails as they develop and iterate.

What will I be doing?

As a Data Engineer on the ground-breaking Route project, you'll develop and maintain the data infrastructure for a first-of-its-kind synthetic travel survey, generating audience figures for Out-of-Home media in Great Britain. Reporting to a Principal Data and Platform Engineer, you will collaborate with data scientists to design, build, and optimise data pipelines for high-quality audience measurement data.

Your key responsibilities will include:

• Develop robust, scalable data pipelines and optimise data storage solutions on GCP.
• Implement ETL processes and CI/CD pipelines to ensure clean, structured data ready for use.
• Work with data scientists to integrate synthetic models into production environments and provide the guardrails and advice as they develop.
• Provide technical support, troubleshoot issues, and research new technologies to enhance capabilities.
• Document pipelines and the platform including architectures and user guides, helping to enforce data management standards.
• Participate in agile ceremonies and provide occasional client interaction.
• Engage in DataOps practices and improve data delivery performance.

Our Tech Stack:

• GCP: GCS, BigQuery, GKE, Artifact Registry, Vertex AI, App Engine, Data Store, Secret Manager, Pub/Sub
• Open-Source Tools: Argo Workflows, Argo Events, dbt, Elementary, Cerberus, Terraform, Jupyter Hub, Docker, Kubernetes
• Coding Languages: Python, SQL, JavaScript (minimal)
• CI/CD & PM Tools: Azure DevOps, Confluence

What do I need to bring with me?

It is essential that your personal attributes compliment your technical skills. To be successful in this role you will need the following skills and experience:

• A minimum of 3 years relevant commercial experience with experience of scalable data pipelines using Argo on GKE, SQL on BigQuery, Python libraries like Pandas.
• Comfortable with APIs and Cloud storage systems.
• Basic web application development knowledge using Flask, HTML, JavaScript.
• Experience with containerisation (Docker) and orchestration (Kubernetes).
• Familiarity with Terraform and data systems optimisation.
• Commitment to data quality and experience in synthetic data, AI/ML model deployment.
• Excellent communication skills and a collaborative and positive mindset.
• Willingness to learn.
• GCP certifications are a plus.

What is in it for me?

Ipsos UK offer an attractive basic salary and a rewards package including 25 days annual leave, a pension scheme and a great range of flexible benefits to suit your personal needs. For roles at Research Manager level and above we also offer private healthcare.

In addition to this we have a fantastic Learning & Development offer delivered through a mix of face to face, online or on-demand; you can read more by clicking here.

We realise you may have commitments outside of work and will consider flexible working applications - please highlight what you are looking for when you make your application.

Ipsos is committed to equality, treating people fairly, promoting a positive and inclusive working environment and ensuring we have diversity of people and views. We also recognise that this is important for our business success - a more diverse workforce will enable us to better reflect and understand the world we research and ultimately deliver better research and insight to our clients.

About Us

Ipsos is one of the world's largest research companies and currently the only one primarily managed by researchers, ranking as a #1 full-service research organization for four consecutive years. With over 75 different data-driven solutions, and presence in 90 markets, Ipsos brings together research, implementation, methodological, and subject-matter experts from around the world, combining thematic and technical experts to deliver top-quality research and insights. Simply speaking, we help the biggest companies solve some of their biggest problems, serving more than 5000 clients across the globe by providing research, data, and insights on their target markets. And we're proud to share we've received our Great Place to Work Certification in 2022 & 2023!