Lead Test Automation Engineer

Expereo; Amsterdam; On-site; EUR 65,000 - 95,000; Full time

Benefits offered by this job

Hybrid remote model

Competitive compensation

International environment

Job summary

Expereo, the Intelligent Internet Platform, invites applications for a Test Automation Engineer to join the Observability & Monitoring team in Amsterdam. You will design automated testing solutions for high-volume telemetry and dashboards, ensuring reliability across services and data pipelines.

You will build frameworks, validate metrics and logs, and integrate tests into CI/CD pipelines using Grafana, Kibana, Elastic stack, PostgreSQL, and AWS.

Qualifications

• Strong experience in software testing and test automation.
• Solid programming skills in Python.
• Experience building and maintaining test frameworks and automation tooling.
• Experience testing APIs, backend systems, and distributed services.
• Strong ability to work with data-intensive systems (metrics, logs, events).
• Understanding of CI/CD pipelines and automated quality gates.
• Experience in Agile/Scrum teams (Nice to have).

Responsibilities

• Define team's testing strategy.
• Design and implement automated test frameworks and tooling for backend systems and APIs.
• Develop end-to-end and integration test suites for observability platforms.
• Validate the correctness, consistency, and completeness of metrics, logs, and alerting systems.
• Analyze system behavior to detect false positives, false negatives, and data inconsistencies.
• Test dashboards and visualizations built with Grafana and Kibana.
• Test data flows across time-series and relational databases.
• Integrate test suites into CI/CD pipelines and enforce automated quality gates.
• Work closely with developers to improve system testability and reliability.
• Identify coverage gaps and build scalable automation solutions.
• Participate in incident analysis and design tests to prevent regressions.
• Ensure changes are covered by appropriate regression tests to maintain system stability.

Skills

Software testing

Test automation

APIs

Distributed systems

CI/CD pipelines

Python

Data-intensive systems

Tools

Elastic stack

Kibana

Grafana

InfluxDB

PostgreSQL

Kubernetes

AWS

Job description

We are theIntelligent Internet Platform.We connectPeople, PlacesandThingsanywhere,managing Internet Performancebetter than anyone else, while providingOne Global Experience,givingVisibility, ControlandSecuritythroughexpereoOne.

Expereo believes in the power of Internet connectivity. As the world's largest provider of managed internet, SD‑WAN/SASE, and Cloud connectivity solutions, we power enterprises and government sites worldwide, helping to enhance every business' productivity with flexible and optimal Internet performance.

As a trusted partner of Fortune 500 enterprises and carriers, our continued aim and success in helping both our customers and partners depends solely on the talented individuals that make Expereo a dynamic, effective, multicultural, and equitable environment.

About the role

We are looking for a Test Automation Engineer to join our Observability & Monitoring software development team. The team builds and operates internal, custom monitoring and observability platforms that provide deep visibility into our services, enabling proactive detection, faster incident resolution, and improved reliability across the company.

As an Automation Engineer, you will take an engineering‑first approach to quality, designing and building automated testing solutions, frameworks, and tooling to ensure the reliability of systems handling large volumes of metrics, logs, alerts, dashboards, and data pipelines.

A key challenge in this role is working with high‑volume telemetry data, where quality is not only about correctness but also about signal accuracy — reducing false positives, detecting missing data, and ensuring that the system reflects reality as closely as possible.

Whatyou'lldo

• Define team's testing strategy
• Design and implement automated test frameworks and tooling for backend systems and APIs
• Develop end‑to‑end and integration test suites for observability platforms
• Validate the correctness, consistency, and completeness of metrics, logs, and alerting systems
• Analyze system behavior to detect false positives, false negatives, and data inconsistencies
• Test dashboards and visualizations built with Grafana and Kibana
• Test data flows across time‑series and relational databases
• Integrate test suites into CI/CD pipelines and enforce automated quality gates
• Work closely with developers to improve system testability and reliability
• Identify coverage gaps and build scalable automation solutions
• Participate in incident analysis and design tests to prevent regressions
• Ensure changes are covered by appropriate regression tests to maintain system stability

Our tech stack (what you'll work with)

• Python (services and test automation)
• Elastic stack (logs, events, search)
• Kibana dashboards and visualizations
• Grafana dashboards and alerting
• PostgreSQL (relational data)
• AWS services (cloud infrastructure)
• APIs and backend services supporting a custom, in‑house monitoring platform
• CI/CD pipelines with automated testing and quality gates
  

We are theIntelligent Internet Platform.We connectPeople, PlacesandThingsanywhere,managing Internet Performancebetter than anyone else, while providingOne Global Experience,givingVisibility, ControlandSecuritythroughexpereoOne.

Expereo believes in the power of Internet connectivity. As the world's largest provider of managed internet, SD‑WAN/SASE, and Cloud connectivity solutions, we power enterprises and government sites worldwide, helping to enhance every business' productivity with flexible and optimal Internet performance.

As a trusted partner of Fortune 500 enterprises and carriers, our continued aim and success in helping both our customers and partners depends solely on the talented individuals that make Expereo a dynamic, effective, multicultural, and equitable environment.

About the role

We are looking for a Test Automation Engineer to join our Observability & Monitoring software development team. The team builds and operates internal, custom monitoring and observability platforms that provide deep visibility into our services, enabling proactive detection, faster incident resolution, and improved reliability across the company.

As an Automation Engineer, you will take an engineering‑first approach to quality, designing and building automated testing solutions, frameworks, and tooling to ensure the reliability of systems handling large volumes of metrics, logs, alerts, dashboards, and data pipelines.

A key challenge in this role is working with high‑volume telemetry data, where quality is not only about correctness but also about signal accuracy — reducing false positives, detecting missing data, and ensuring that the system reflects reality as closely as possible.

Whatyou'lldo

• Define team's testing strategy
• Design and implement automated test frameworks and tooling for backend systems and APIs
• Develop end‑to‑end and integration test suites for observability platforms
• Validate the correctness, consistency, and completeness of metrics, logs, and alerting systems
• Analyze system behavior to detect false positives, false negatives, and data inconsistencies
• Test dashboards and visualizations built with Grafana and Kibana
• Test data flows across time‑series and relational databases
• Integrate test suites into CI/CD pipelines and enforce automated quality gates
• Work closely with developers to improve system testability and reliability
• Identify coverage gaps and build scalable automation solutions
• Participate in incident analysis and design tests to prevent regressions
• Ensure changes are covered by appropriate regression tests to maintain system stability

Our tech stack (what you'll work with)

• Python (services and test automation)
• Elastic stack (logs, events, search)
• Kibana dashboards and visualizations
• Grafana dashboards and alerting
• InfluxDB (time‑series data)
• PostgreSQL (relational data)
• Kubernetes (container orchestration)
• AWS services (cloud infrastructure)
• APIs and backend services supporting a custom, in‑house monitoring platform
• CI/CD pipelines with automated testing and quality gates
  

Requirements

Required

• Strong experience in software testing and test automation
• Solid programming skills in Python
• Experience building and maintaining test frameworks and automation tooling
• Experience testing APIs, backend systems, and distributed services
• Strong ability to work with data‑intensive systems (metrics, logs, events)
• Ability to analyze system behavior and detect anomalies, inconsistencies, and signal quality issues
• Understanding of CI/CD pipelines and automated quality gates
• Strong analytical and problem‑solving skills

Nice to have

• Experience with observability or monitoring platforms
• Familiarity with Elastic, Kibana, Grafana, InfluxDB, PostgreSQL
• Exposure to Kubernetes and cloud environments (AWS)
• Experience testing distributed systems
• Knowledge of performance, reliability, or resilience testing
• Experience in Agile / Scrum teams

How we work

• Quality is an engineering responsibility, not a final checkpoint
• Testing is code‑driven, automated, and scalable
• Strong focus on data correctness, signal quality, and system reliability
• We continuously balance precision vs noise in monitoring systems
• We value pragmatism, ownership, and continuous improvement
• We work in a hybrid remote model, balancing flexibility with collaboration
  

Benefits

• Work on core internal platforms with high impact on reliability and operations
• Challenges involving large-scale telemetry, signal accuracy, and system behavior
• Strong engineering culture with collaboration across testing, development, and DevOps
• Modern, cloud-native and automation‑first environment
• Hybrid remote working model
• Competitive compensation and local benefits
• International, collaborative engineering environment

Beyond the Job

We're proud of our focus onEnvironment, Social and Governanceas well as the passion we display for the communities where we live and work.

EEO (Equal Employments Opportunities) Statement:

Expereo is an Equal Opportunities employer who aims to support and celebrate every employee that comes through our doors. We respect and support all of our people regardless of background, religion, nationality, sexual orientation, age, or physical condition.