Senior Data Engineer

IDX; Greater London; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A leading data solutions company is seeking a Senior Data Engineer to build data pipelines and integrate AI tools for actionable insights. The role includes designing data models, optimizing ETL processes, and collaborating with clients to deliver impactful data solutions. This position allows for hybrid working arrangements, with competitive benefits including annual leave and health plans.

Benefits

25 days annual leave plus birthday off

Hybrid working options

Health cash plan

Private medical insurance

Discounted gym membership

Qualifications

• 5+ years’ experience in a tech company or agency tech/data team.
• Advanced SQL skills and hands‑on experience with BigQuery or similar.
• Proficient in Python (or R) for data transformation.

Responsibilities

• Build and maintain ETL pipelines to integrate data from various sources.
• Design and optimize scalable data models in BigQuery.
• Automate reporting processes for efficient insights.

Skills

Data integration

SQL

Python

Data analysis

AI/ML integration

Tools

BigQuery

APIs

Job description

London, England | GBR
London, LONDO SE12QN, GBR

Description

Join us to build powerful data pipelines, integrate AI, and turn complex data into clear, actionable insights. If you're a Senior Data Engineer with an interest in automation, analytics, and impact—we want to hear from you.

Why Join IDX?

Not Just Any Brands:See your work come to life for iconic brands like Rolls-Royce, Vodafone and Bupa.

Collaborative Spirit:Work alongside passionate innovators who share your thirst for progress.

Continuous Learning:Grow your skills with ongoing training, mentorship, and the freedom to experiment.

Fast Paced & Fun:Thrive in a dynamic environment where big ideas and bold action collide.

Cutting-Edge Technology:Play with the latest analytics tools, use AR to build immersive digital events, and explore the future of brand storytelling!

Global Presence:We Get It Done morning, day and night with offices across multiple time-zones!

🏝️ 25 days annual leave, plus a day for your birthday and holiday trade scheme available!

🏡 Hybrid working (Tue/Wed/Thu in office)

🤸♀️ Flexibility; for when life happens

👓 Health cash plan allowing you to claim back on every day healthcare costs incl. dental, vision, psychotherapy, acupuncture and more!

🏥 Private medical insurance, available by personal contribution

💪 Discounted gym membership options at Fitness First

💰 TechScheme and Shop Street access

🎉 Culture Committee focused on regular social, educational and community based activities

The Gig

We're looking for a skilled Senior Data Engineer to help us transform raw data into meaningful insight. As our first Data Engineer, you’ll build smart data pipelines, integrate AI tools, and bring audience behaviour to life through advanced analytics and visualisation.

In this client-facing role, you’ll collaborate directly with our amazing client base to understand their needs and deliver impactful, data-driven solutions. If you're excited by data, automation, and impact—you’ll fit right in.

What You'll Be Doing

Data Integration & Transformation

• Build and maintain ETL/ELT pipelines to bring in data from platforms like Leadfeeder, Brandwatch, and other APIs.
• Write Python (or similar) scripts to transform and normalise complex nested JSON data structures.
• Combine data from multiple sources to create a unified, insight-ready view of user behaviour.

BigQuery & Data Engineering

• Design and optimise scalable data models in BigQuery (or similar cloud data warehouses).
• Write advanced SQL for reporting, analysis, and automation.
• Create schemas that map the relationships between leads, website visits, and company profiles.
• Build systems to monitor and maintain data quality.
• Present raw data in a clear, compelling way for marketing and executive teams.
• Automate reporting processes for efficient and scalable insights.
• Use proprietary and public data to identify investment trends, shareholder activity, and investor interests.
• Segment audiences based on behaviour, content engagement, and interests.
• Use GA4 to build real-time reports across campaigns and define tagging/event models to improve tracking accuracy.

AI & Automation

• Integrate AI tools like OpenAI or Anthropic for smart tagging, content classification, and insight generation.
• Build reusable prompt engineering frameworks for consistent, reliable analysis.
• Combine AI-generated insights with structured data to uncover patterns in audience behaviour.
• Design systems to classify companies based on how they engage with content and media.
• Work closely with creative, content, and media teams to ensure insights feed into strategic decisions.
• Provide strategic recommendations based on data to improve messaging and campaign effectiveness.
• Support cross-functional projects by creating dashboards, data stories, and research briefs.

About You

• 5+ years’ experience in a tech company or agency tech/data team
• Advanced SQL skills and hands‑on experience with BigQuery or similar cloud data warehouses (e.g. Snowflake, Redshift)
• Proficient in Python (or R) for data transformation and working with APIs
• Familiarity with AI/ML integration, especially LLMs like OpenAI or Anthropic APIs
• Skilled at integrating multiple data sources — from web analytics and CRM to social media APIs
• Solid experience in data analysis, insight generation, and storytelling
• Exposure to natural language processing (NLP) and sentiment analysis frameworks
• Understanding of B2B marketing and sales analytics
• Experience with audience segmentation and behavioural data analysis
• Able to translate complex data into clear, actionable insights

About Us

IDX isn't your average communications company. With over 20 years industry experience and a portfolio of prominent global clients, our award‑winning communication solutions are seen by billions every month across a global audience.

We seek The Bold. Shatter expectations, push boundaries – that's the fuel that ignites our powerhouse team. Collaboration is our superpower, where we bring expertise and individuality to elevate and deliver. Rising Stars with boundless hunger, this is your launchpad. Seasoned pros who want to define their Legacy in the industry, this is your home.Be BOLD – Own Your Story at IDX.

An Inclusive Workplace

IDX is an Equal Opportunity Employer. We aim to foster an environment that desires and recruits diverse talent, cultivates a culture that celebrates all identities, life experiences, perspectives, and ensures equal opportunity for all.

Not sure you meet every requirement? We’d still love to hear from you.

Studies show that people from underrepresented groups often don’t apply unless they meet every qualification. We know that no candidate is perfect, and we value diverse backgrounds and experiences.

If you need any support or adjustments during the hiring process, just let us know — we’re happy to help.