Senior Software Engineer, Alerting Platform 2 months ago

CommandLink, LLC; Philippines; Remote; PHP 3,822,000 - 7,006,000; Full time

Benefits offered by this job

100% remote position

Room to grow at a high-growth company

Flexible time off

Employee referral bonuses

Job summary

Command|Link is a global SaaS platform offering network, voice services, and IT security solutions. As a Senior Software Engineer on Command|Alert, you will own large parts of the correlation and alerting engine end-to-end, from rule evaluation to delivery and downstream notification, while mentoring others.

You will design solutions for high-fidelity alerts, ensure reliability under sustained load, and collaborate with engineers to ship improvements, with opportunities to lead independent

Qualifications

• Experience designing, building, or operating high-reliability alerting or notification systems in production.
• Strong Kafka experience for event streaming delivery for downstream delivery.
• Expertise with OpenSearch and OpenTelemetry.
• Ability to own components end-to-end and mentor peers.

Responsibilities

• Design and own alerting evaluation and notification pipelines.
• Ensure reliability of major alerting components under load.
• Collaborate across teams to implement scalable telemetry and correlation.
• Lead post-mortems and drive long-term fixes.

Skills

Alerting design

End-to-end ownership

Mentoring

Reliability engineering

Education

Bachelor’s degree

Tools

Kafka

OpenSearch

OpenTelemetry

Python

Go

Kubernetes

Multi-cloud

Job description

About Command|Link

Command|Link is a global SaaS Platform providing network, voice services, and IT security solutions, helping corporations consolidate their core infrastructure into a single vendor and layering on a proprietary single pane of glass platform. Command|Link has revolutionized the IT industry by tackling the problems our competitors create. In recognition for our unprecedented innovation and dedication, Command|Link was recognized as the SD-WAN Product of the Year, ITSM Visionary Spotlight, UCaaS Product of the Year, NaaS Product of the Year, Supplier of the Year, and the AT&T Strategic Growth Partner. Command|Link has built the only IT platform for scale that solves ISP vendor sprawl and IT headaches. We make it easy for our customers to get more done, maximize uptime and improve the bottom line.

• Learn more about us here!
• This is a 100% remote position

About Your New Role

Command|Alert is CommandLink's signal-processing core: the engine that turns raw security, monitoring, and customer-defined telemetry into alerts customers actually trust. Alert fatigue and noise are the top complaint across every competitor in this space, and this role exists to make sure our alerts are the ones people don't tune out.

As a Senior Software Engineer on Command|Alert, you'll own large components of the correlation and alerting engine end to end, from rule evaluation and anomaly detection through delivery and downstream notification. You'll design solutions for the team's hardest reliability and correlation problems, coordinate with other engineers to get them shipped, and take on independent projects that push the product forward, all while teaching and mentoring the engineers around you.

Key Responsibilities

Design and own solutions for how Command|Alert evaluates rule-based thresholds, ML anomaly scores, and correlation logic to produce high-fidelity alerts, for both platform-defined and customer-defined alerts.

Own the reliability of major pieces of the alerting pipeline, from OpenSearch alert evaluation through Kafka delivery via OpenSearch callbacks to downstream notification, including idempotency guarantees and soak-tested behavior under sustained load.

Help turn diverse telemetry sources, security tooling, monitoring data, syslog, OpenTelemetry, and L2-L4 network protocols, into usable network and system topologies and their dependencies, and make that context usable for LLM reasoning over investigations and remediation.

• Contribute to the technical groundwork for generating alert definitions from the normalized data model using LLMs.
• Act as a primary driver on resolving production issues in your area, running post-mortems and owning the long-term fixes that come out of them.
• Take on independent, greenfield projects that push Command|Alert's correlation and detection capability forward.
• Help decide when to spike, prototype, or build an MVP, and rally the team around the plan.
• Actively teach and mentor engineers on your team, and share knowledge that raises the whole team's effectiveness.
• Instigate design discussions and represent Command|Alert's technical direction in cross-team conversations.
• Takes on additional responsibilities and projects as needed to support the success of the team and organization.

Required

What you’ll need for success:

• Experience designing, building, or operating high-reliability alerting or notification systems in production, including running rule-based and ML-based detection logic against real traffic at scale.
• Strong Kafka experience, particularly producing and consuming event streams for downstream delivery.

A working command of telemetry and protocol data: security tooling output, monitoring telemetry, syslog, OpenTelemetry, NetFlow or sFlow, SNMP, ICMP, and firewall logs, with the ability to turn that data into real network and system topologies and dependency maps.

• A track record building or operating systems where webhook reliability, idempotency, and delivery guarantees under load are non-negotiable.
• Mastery of Go and/or Python, with range across container orchestration and a multi-cloud footprint.
• A track record owning large components or systems end to end and coordinating with other engineers to deliver them.
• Why you’ll love life at Command|Link

Join us at CommandLink, where you'll have the opportunity to shape the future of business communication. We value the innovative spirit and seek individuals ready to bring their unique vision and expertise to a team that values bold ideas and strategic thinking. Are you ready to make an impact?

• Room to grow at a high-growth company
• An environment that celebrates ideas and innovation
• Your work will have a tangible impact
• Flexible time off
• Fun events at cool locations
• Employee referral bonuses to encourage the addition of great new people to the team

At CommandLink, we’re committed to creating a fair, consistent, and efficient hiring experience. As part of our process, we use AI-assisted tools to help review and analyze applications. These tools support our recruiting team by identifying qualifications and experience that align with the requirements of each role.

AI tools are used only to assist in the evaluation process - they do not make final hiring decisions. Every application is reviewed by a member of our recruiting or hiring team before any decisions are made.