Platform Engineer — Ci/Cd Gate & Online Evaluation

Intellias; Sevilla; Presencial; EUR 60.000 - 90.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work options

Descripción de la vacante

Intellias en Sevilla, Andalucía, busca un Platform Engineer enfocado en CI/CD Gate y Evaluación en Línea para establecer controles de calidad automatizados en plataformas enterprise IA y sistemas basados en agentes. Gestionará flujos de evaluación en pipelines, dashboards de rendimiento y alertas para visibilidad operativa de IA.

El rol requiere experiencia en ingeniería DevOps/Platform, integración con GitHub Actions y diseño de dashboards en CloudWatch, con opciones de teletrabajo desde España.

Formación

• 4+ años en plataforma o ingeniería DevOps.
• Integración de pipelines CI/CD para gates de calidad.
• Diseño de dashboards y alarmas en CloudWatch.
• AWS AgentCore Evaluation API (modo on‑demand) para CreateEvaluation en pipelines CI/CD.
• Integración de GitHub Actions para gate de despliegue de evaluación.
• Configuración de evaluaciones en línea (AgentCore online, sampling configurable).
• Dashboards de CloudWatch para puntuaciones por agente y evaluador a lo largo del tiempo.
• Configuración de alarmas de CloudWatch para umbrales de degradación de calidad.

Responsabilidades

• Diseñar e implementar gates de calidad CI/CD usando AgentCore Evaluation para validar agentes IA y flujos de trabajo antes del despliegue.
• Integrar la ejecución de evaluaciones en GitHub Actions y pipelines de despliegue para apoyar decisiones de lanzamiento.
• Configurar y mantener flujos de evaluación en línea para validación previa al lanzamiento y detección de regresiones.
• Implementar capacidades de evaluación en línea, incluyendo estrategias de muestreo en producción y programación de evaluaciones.
• Crear dashboards en CloudWatch que muestren puntuaciones de evaluación y tendencias de calidad.
• Configurar alarmas y mecanismos de notificación para detectar degradación de calidad, regresiones de rendimiento y problemas de fiabilidad.
• Colaborar con ingenieros de IA para definir umbrales de evaluación, criterios de lanzamiento y estándares de aceptación de calidad.
• Soportar observabilidad a nivel de plataforma integrando resultados de evaluación en monitoreo e informes operativos.
• Analizar resultados de evaluación e identificar regresiones entre versiones de agentes, prompts y herramientas.
• Desarrollar y mantener automatización para validación continua de sistemas IA a lo largo del ciclo de vida del software.
• Colaborar con equipos de plataforma y DevOps para mejorar la seguridad de despliegue y controles de gobernanza.

Conocimientos

Platform engineering

DevOps engineering

CI/CD integration

Observability

Herramientas

GitHub Actions

AWS AgentCore

CloudWatch

AgentCore Evaluation API

Descripción del empleo

Platform Engineer — CI/CD Gate & Online Evaluation Intellias•Sevilla, andalucía, Spain

Descripción del trabajo

Location: Remote from Spain (an indefinite Spanish employment contract)

We are looking for a Platform Engineer — CI/CD Gate & Online Evaluation to help establish automated quality controls for enterprise AI platforms and agent-based systems. In this role, you will integrate evaluation workflows into deployment pipelines, configure online quality monitoring, and build operational visibility for AI performance and reliability. You will work closely with platform, DevOps, AI engineering, and governance teams to ensure that AI agents meet quality standards before and after production deployment.

Project Overview:

Our customer is a multinational corporation with more than a century of history and offices in over 180 countries. Their most ambitious goal at the time is to introduce a range of Reduced-Risk Products (RRPs). The target audience is more than 1 billion consumers around the globe. IT platform hosts 700+ applications.

Intellia's mission is to help the client with the engineering of a comprehensive software ecosystem for a game-changing IoT product on the margin of innovative consumer experience and cutting-edge technology. Our teams are involved in the engineering of core platform components for best-in-class eCommerce, Digital Marketing and IoT solutions. As an Engineer, you will become a part of Core Architecture Team and be responsible for the architecture, implementation of best practices in our Digital Engineering Enterprise Platform.

The Platform is a set of services and internet applications that accelerate the development and delivery of software applications by taking care of common SDLC challenges. The Platform provides access and consumption for engineering teams to a set of services, technologies, practices for their development and for operating their application, ensuring a set of compliance and best practices.

Requirements:

• 4+ years platform or DevOps engineering
• CI/CD pipeline integration for quality gates
• CloudWatch dashboard and alarm design
• AWS AgentCore Evaluation API (on-demand mode — CreateEvaluation in CI/CD pipelines)
• GitHub Actions integration for evaluation deployment gate
• Online evaluation configuration (AgentCore online mode, configurable sampling rate)
• CloudWatch dashboards for per-agent per-evaluator evaluation scores over time
• CloudWatch alarm configuration for quality degradation thresholds

Nice-to-have:

• AWS AgentCore Evaluation online mode sampling configuration
• AWS AgentCore Runtime version comparison using evaluation (regression detection)
• CloudWatch EMF for structured evaluation score metrics

Responsibilities:

• Design and implement CI/CD quality gates using AWS AgentCore Evaluation to validate AI agents and workflows before deployment.
• Integrate evaluation execution into GitHub Actions and deployment pipelines to support automated release decisions.
• Configure and maintain on-demand evaluation workflows for pre-release quality validation and regression detection.
• Implement and manage online evaluation capabilities, including production sampling strategies and evaluation scheduling.
• Build CloudWatch dashboards that provide visibility into evaluation scores, quality trends, and agent performance over time.
• Configure CloudWatch alarms and notification mechanisms to detect quality degradation, performance regressions, and reliability issues.
• Collaborate with AI engineers to define evaluation thresholds, release criteria, and quality acceptance standards.
• Support platform-wide observability by integrating evaluation results into monitoring and operational reporting workflows.
• Analyze evaluation outcomes and identify quality regressions across agent versions, prompts, tools, and workflows.
• Develop and maintain automation that enables continuous validation of AI systems throughout the software delivery lifecycle.
• Partner with platform and DevOps teams to improve deployment safety, operational readiness, and governance controls for AI workloads.
• Contribute to the evolution of enterprise AI quality engineering practices, deployment standards, and monitoring frameworks. xkdbapo

Hay opciones de teletrabajo/trabajo desde casa disponibles para este puesto.