DataOps Engineer – 24i Personalization Team

24/i; Madrid; Presencial; EUR 65.000 - 90.000; Jornada completa

Descripción de la vacante

24i is seeking a DataOps Engineer within the Personalization team to design and operate the data pipelines powering analytics, recommendations, and client reporting. You will blend data engineering, backend development, and cloud infrastructure to build reliable pipelines and services in a collaborative environment.

You will work with Python and SQL, develop in AWS, implement CI/CD, and ensure observability and data quality across the platform while partnering with cross-functional teams.

Formación

• Strong Python development for production backend and data systems.
• Strong SQL skills with analytical or operational datasets.
• Experience designing or maintaining data pipelines and processing workflows.
• Understanding of data modelling, transformation, and data quality.
• Hands-on experience in cloud environments, preferably AWS.
• Experience with workflow orchestration and reliable data pipelines.
• Observability implementation with logging, metrics, tracing, and monitoring.
• Automated tests including unit and integration testing.
• CI/CD practices and automated software delivery.
• Solid software engineering fundamentals for production systems.

Responsabilidades

• Design, build, and maintain data ingestion and processing pipelines for analytics, personalization, and recommendations.
• Work with structured and semi-structured data across cloud storage and processing systems.
• Develop and maintain data orchestration workflows with reliable retries and recovery.
• Contribute to data modelling and transformation for downstream consumption.
• Ensure data quality, consistency, and reliability across the platform.
• Address performance, scalability, and cost issues in data workloads.
• Design, develop, and maintain Python-based backend services and integrations for the Personalization platform.
• Understand legacy codebases to fix issues and implement new functionality.
• Write high-quality, maintainable code adhering to requirements and backward compatibility.
• Collaborate on product requirements and communicate technical approaches and risks.

Conocimientos

Python

SQL

Data pipelines

Data modelling

Cloud AWS

Observability

CI/CD

Testing

Production systems

Backend

Herramientas

Airflow

Terraform

AWS CDK

OpenTelemetry

CloudFormation

Descripción del empleo

As a DataOps Engineer at 24i, working within the Personalization team, you will be a member of a collaborative and innovative engineering team. Reporting to the Backend Engineering Lead, you will have a hands-on role throughout the full software development lifecycle, contributing to the development and operation of the cloud-based platform that powers our personalization, recommendations, and analytics capabilities.

The role combines data engineering, backend development, and cloud infrastructure, with a particular focus on building and operating reliable data pipelines and services. You will work with large and diverse datasets, helping ensure that data is ingested, processed, monitored, and made available efficiently and reliably across the platform.

You will also work closely with teams across the wider 24i organization, helping provide the data and services required for client performance reporting, recommendation models, personalization, and analytics.

As a guide, you will have several years of experience delivering production software and data systems. We value engineers with strong foundations in data and backend engineering who are also comfortable working across engineering boundaries when required.

Key Responsibilities

Data Engineering & Operations

• Design, build, and maintain reliable data ingestion and processing pipelines supporting analytics, personalization, and recommendation use cases.
• Work with structured and semi-structured datasets across cloud-based storage and processing systems.
• Develop and maintain data orchestration workflows, ensuring that dependencies, retries, failures, and recovery are handled reliably.
• Contribute to data modelling and transformation processes that make data efficient and practical for downstream consumers.
• Help ensure the quality, consistency, and reliability of data as it moves through the platform.
• Identify and address performance, scalability, and cost issues within data processing workloads.

Backend & Platform Engineering

• Design, develop, and maintain Python-based backend services and integrations supporting the Personalization platform.
• Quickly understand existing codebases in order to analyse behaviour, fix issues, and implement new functionality.
• Write high-quality, maintainable code that meets both functional and non-functional requirements.
• Refactor and improve existing systems while preserving expected behaviour and maintaining backwards compatibility where required.
• Design solutions based on product requirements and user stories, communicating technical approaches, effort, trade-offs, and risks with the rest of the team.

Cloud, Deployment & Observability

• Develop and operate services and data workloads running in cloud environments, primarily AWS.
• Contribute to cloud infrastructure and deployment processes, including Infrastructure as Code and CI/CD pipelines.
• Build and improve observability across services and data pipelines, using logging, metrics, tracing, and alerting to understand system behaviour and diagnose issues.
• Contribute to the team's use of modern observability standards and tooling, such as OpenTelemetry.
• Help ensure that changes can be deployed safely and reliably across development, staging, and production environments.

Quality & Collaboration

• Design and implement appropriate unit, integration, and functional tests to ensure that systems are fit for purpose.
• Review other team members' work and provide constructive feedback through code and design reviews.
• Diagnose and resolve issues across data pipelines, backend services, infrastructure, and customer environments.
• Identify opportunities to improve our architecture, development lifecycle, tooling, reliability, and engineering practices.
• Support less experienced team members through code reviews, technical discussions, documentation, and sharing of engineering best practices.
• Plan and prioritise your work effectively and collaborate closely with other members of the engineering team.

Client Data & Integrations

• Work with both new and existing clients, as well as internal 24i teams, to onboard and integrate data into the Personalization platform.
• Investigate data quality, integration, and platform issues encountered during onboarding and ongoing operation.
• Support existing integrations as client requirements and platform capabilities evolve.

Skills and Requirements

Must Have

• Strong Python development skills, including experience building production backend and/or data systems.
• Strong SQL skills and experience working with analytical or operational datasets.
• Experience designing, building, or maintaining data pipelines and data processing workflows.
• Understanding of data modelling, transformation, and data quality principles.
• Hands-on experience developing and operating systems in a cloud environment, preferably AWS.
• Experience with workflow orchestration and the operational challenges of running data pipelines reliably.
• Experience implementing and operating observability for production systems using logging, metrics, tracing, and monitoring.
• Experience designing and implementing automated tests, including unit and integration testing.
• Experience with CI/CD practices and automated software delivery.
• Strong software engineering fundamentals, including the ability to design, debug, review, refactor, and maintain production systems.

Desirable

• AWS serverless technologies such as Lambda, API Gateway, SQS, S3, Athena, and Glue.
• Infrastructure as Code technologies such as CloudFormation, Terraform, or AWS CDK.
• Data orchestration technologies and patterns.
• OpenTelemetry or similar observability technologies.
• Columnar data formats and analytical data platforms.
• Elasticsearch or similar search and indexing technologies.
• React and TypeScript development.
• Data Science and Machine Learning modelling techniques.
• Recommendation systems and personalization technologies.
• Analytics and Business Intelligence products such as Tableau or Power BI.
• Experience developing within an Agile framework such as Scrum or SAFe.
• AWS certifications such as SysOps Administrator, Developer, or Solutions Architect.
• TV, VOD, streaming, or media domain knowledge.

The Kind of Engineer We're Looking For

This role is primarily focused on data, backend, and platform engineering, but we work in a collaborative environment where engineers may occasionally contribute outside their primary area of expertise. You should be comfortable working across traditional engineering boundaries when needed - whether that means investigating cloud infrastructure, improving a deployment pipeline, helping diagnose an analytics issue, supporting a data-science workflow, or occasionally contributing to frontend functionality. We don't expect you to be an expert in all of these areas. We're looking for someone with strong foundations in data and backend engineering, combined with the curiosity and engineering mindset required to understand and improve the wider platform.