Site Reliability Engineer - Telemetry

CryptoproNetwork; Brasil; Presencial; BRL 180 000 - 300 000; Tempo integral

Resumo da oferta

Payward is building a cutting-edge telemetry platform for the Kraken ecosystem, focusing on observability across metrics, logs, traces, and profiling. You will work with challenges in reliability at scale and collaborate with software, platform, security, and SRE teams to keep critical services running smoothly.

The role emphasizes distributed systems, automation, and incident response, with a chance to contribute to operational improvements and runbooks inspired by real incidents.

Qualificações

• 3+ years of experience in a production engineering role focused on reliability and observability.
• Experience managing telemetry platforms at scale (metrics, logs, traces, profiles).
• Experience with Prometheus or Prometheus-compatible stacks for collection, querying, and alerting.

Responsabilidades

• Operate and improve the shared platform for metrics, logs, traces, alerting, dashboards, and profiling.
• Maintain metrics collection, long-term storage, querying, dashboards, and alerting using Prometheus-compatible systems, VictoriaMetrics, Grafana, and modern alerting tools.
• Operate log pipelines using Vector, Splunk, and Loki, including reliability, throughput, and troubleshooting.
• Operate distributed tracing and profiling capabilities using Grafana Alloy, Tempo, OpenTelemetry, and Pyroscope.
• Deploy and manage telemetry services using Terraform, Terragrunt, and container orchestration across multiple environments.
• Troubleshoot missing data, slow queries, broken alerts, pipeline backpressure, and capacity issues.
• Build reusable configuration and automation that helps teams manage dashboards, alerts, and telemetry integrations safely.
• Participate in incident response and on-call, write runbooks, and improve the platform using what we learn from incidents.

Conhecimentos

Observability

Distributed systems

Automation

SRE practices

Incident response

Ferramentas

Prometheus

VictoriaMetrics

Grafana

Vector

Splunk

Loki

Grafana Alloy

Tempo

OpenTelemetry

Pyroscope

Terraform

Terragrunt

Nomad

Kubernetes

CI/CD

Descrição da oferta de emprego

Building the Future of Open Finance

Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system.

Join our engineering team as a Site Reliability Engineer focused on the shared telemetry platform that helps teams understand, operate, and improve production services. You will work across metrics, logs, traces, alerting, dashboards, and profiling systems that make our platform observable at scale.

As a member of the Telemetry team, you will help keep the systems that collect, store, query, and route operational data reliable and scalable. This is a hands-on role for an engineer who enjoys distributed systems, automation, observability, and solving production problems.

You will work with Software Engineers, Platform teams, Security Engineers, and SREs to improve operational practices and support mission-critical services. The role includes incident response, on-call, platform improvements, and helping teams use telemetry effectively.

The opportunity

• Operate and improve the shared platform for metrics, logs, traces, alerting, dashboards, and profiling.

• Maintain metrics collection, long-term storage, querying, dashboards, and alerting using Prometheus-compatible systems, VictoriaMetrics, Grafana, and modern alerting tools.

• Operate log pipelines using Vector, Splunk, and Loki, including reliability, throughput, and troubleshooting.

• Operate distributed tracing and profiling capabilities using Grafana Alloy, Tempo, OpenTelemetry, and Pyroscope.

• Deploy and manage telemetry services using Terraform, Terragrunt, and container orchestration across multiple environments.

• Troubleshoot missing data, slow queries, broken alerts, pipeline backpressure, and capacity issues.

• Build reusable configuration and automation that helps teams manage dashboards, alerts, and telemetry integrations safely.

• Participate in incident response and on-call, write runbooks, and improve the platform using what we learn from incidents.

What you bring

• 3+ years of experience as a Site Reliability Engineer, Platform/Infrastructure Engineer, Observability Engineer, or similar production engineering role.

• Comfortable managing production systems at scale that collect, process, store, and serve telemetry such as metrics, logs, traces, or profiles.

• Experience with Prometheus or a Prometheus-compatible monitoring stack, including metrics collection, querying, and alerting.

• Experience troubleshooting distributed production systems, including availability, latency, data flow, and capacity issues.

• Experience with Infrastructure as Code, particularly Terraform, and CI/CD.

• Experience operating containerised workloads with Nomad, Kubernetes, or similar platforms.

• Solid scripting/programming ability and comfort using AI tools and agents (e.g., Claude) to accelerate delivery.

• Strong incident response, documentation, and collaboration skills.

Nice to haves

• Experience with VictoriaMetrics, Grafana, Tempo, Loki, Vector, Splunk, Alertmanager, or OpenTelemetry.

• Experience with PromQL or LogQL, dashboards or alerts as code.

• Experience with maintaining operators and their related CRDs in Kubernetes.

• Experience with Consul, Vault, AWS, and on-premises or datacentre infrastructure.

• Experience operating high-volume logging, streaming, or data pipelines.

• Experience making practical trade-offs between observability data volume, performance, and cost.

• Background in highly regulated or financial services environments where change management and audit trails are critical.

Unless a specific application deadline is stated in the job posting, applications are accepted on an ongoing basis.

Please note, applicants are permitted to redact or remove information on their resume that identifies age, date of birth, or dates of attendance at or graduation from an educational institution.

We consider qualified applicants with criminal histories for employment on our team, assessing candidates in a manner consistent with the requirements of the San Francisco Fair Chance Ordinance.

Our commitment

Payward is powered by people from around the world and we celebrate the diverse talents, backgrounds, contributions, and unique perspectives that everyone brings to the table. We hire based on merit, seeking out people with the right abilities, knowledge, and skills for the job. We encourage you to apply for roles where you don't fully meet the listed requirements, especially if you're passionate or knowledgeable about crypto.

We may ask candidates to complete job-related skills or work-style assessments as part of our hiring process. These assessments evaluate competencies relevant to the role and are applied consistently across candidates for similar positions. Results are considered alongside experience and interviews, and are not the sole basis for any employment decision.

As an equal opportunity employer, we don't tolerate discrimination or harassment of any kind, whether based on race, ethnicity, age, gender identity, citizenship, religion, sexual orientation, disability, pregnancy, veteran status, or any other protected characteristic as outlined by federal, state, or local laws.

Stay connected

Follow us on Twitter

Learn on the Kraken Blog

Connect on LinkedIn

Candidate Privacy Notice