Remote Platform Engineer — CI/CD Gates & AI Evaluation

Intellias; Albacete; Presencial; EUR 60.000 - 100.000; Jornada completa

Descripción de la vacante

Intellias Castilla-La Mancha, Spain is seeking a Platform Engineer focused on CI/CD gates and online evaluation to strengthen automated quality controls for enterprise AI platforms.

You will integrate evaluation workflows into deployment pipelines, configure online evaluation, build dashboards in CloudWatch, and collaborate with platform, DevOps, AI engineering and governance teams to ensure quality before and after production.

Formación

• 4+ years in platform or DevOps engineering.
• Experience integrating CI/CD gates in deployment pipelines.
• Design and implement CloudWatch dashboards and alarms.
• Experience with AWS AgentCore Evaluation API in CI/CD.
• GitHub Actions integration for evaluation deployment gates.
• Online evaluation configuration with configurable sampling rates.
• Create per-agent evaluation views and trend dashboards.
• Knowledge of governance, security, and change control.

Responsabilidades

• Design and implement CI/CD quality gates using AWS AgentCore Evaluation.
• Integrate evaluation execution into GitHub Actions and pipelines.
• Configure on-demand evaluation workflows for pre-release validation.
• Implement online evaluation capabilities and production sampling strategies.
• Build CloudWatch dashboards showing evaluation scores and trends.
• Configure alarms for quality degradation and reliability issues.
• Collaborate with AI engineers to set thresholds and acceptance criteria.
• Integrate evaluation results into platform observability and reporting workflows.
• Analyze evaluation outcomes to detect regressions across versions.

Conocimientos

Platform engineering

DevOps

CI/CD

Monitoring & observability

GitHub Actions

Herramientas

AWS AgentCore

GitHub Actions

CloudWatch

Descripción del empleo

Intellias Castilla-La Mancha, Spain is seeking a Platform Engineer focused on CI/CD gates and online evaluation to strengthen automated quality controls for enterprise AI platforms.

You will integrate evaluation workflows into deployment pipelines, configure online evaluation, build dashboards in CloudWatch, and collaborate with platform, DevOps, AI engineering and governance teams to ensure quality before and after production.