Network Reliability Engineer

MARGO; United States; Remote; USD 70,000 - 88,000; Full time

Job summary

MARGO is seeking a Site Reliability/Platform Engineer to help build and operate a large AI infrastructure with monitoring, diagnosis, and remediation for production incidents. You will collaborate with multiple engineering teams to keep services healthy and scalable.

The role includes on-call rotations, implementing observability, and lifecycle management across environments and countries, with emphasis on stability, security, and performance.

Qualifications

• Experience with large-scale AI infrastructure and GPU/HPC environments.
• Strong Linux system administration and scripting.
• Experience with monitoring and logging tools (Prometheus, Grafana, Elastic).
• Knowledge of networking concepts (DNS, TCP/IP, VLANs, IPv6).
• Familiarity with IaC (Ansible, Salt, AWX).
• Experience with CI/CD pipelines (GitLab).

Responsibilities

• Build a large AI infrastructure with monitoring, diagnosis, and remediation of production incidents.
• Troubleshoot high-impact production issues in collaboration with other engineering teams
• Participate in an on-call rotation to handle incidents and ensure service continuity
• Implement and maintain observability solutions to monitor AI infrastructure and application health
• Contribute to AI infrastructure lifecycle management across different environments and countries
• Promote and apply best practices in terms of stability, resiliency, scalability, and security
• Maintain clear technical documentation for tools and procedures
• Collaborate closely with development teams to ensure infrastructure readiness- Participate in team rituals and knowledge-sharing initiatives

Skills

Go

Python

Bash

Linux

Networking

GitLab CI/CD

Prometheus

Grafana

Elastic

Ansible

Tools

Prometheus

Grafana

Elastic

Salt

AWX

MariaDB

GitLab

Job description

#HPC #AI #GPU #CLUSTERS

YOUR DAILY ROUTINE

• Build a large AI infrastructure with monitoring, diagnosis, and remediation of production incidents- Troubleshoot high-impact production issues in collaboration with other engineering teams

• Participate in an on-call rotation to handle incidents and ensure service continuity

• Implement and maintain observability solutions to monitor AI infrastructure and application health

• Contribute to AI infrastructure lifecycle management across different environments and countries

• Promote and apply best practices in terms of stability, resiliency, scalability, and security

• Maintain clear technical documentation for tools and procedures

• Contribute to system and tool evolution based on production feedback

• Collaborate closely with development teams to ensure infrastructure readiness- Participate in team rituals and knowledge-sharing initiatives

ABOUT YOU

SOFTSKILLS :

• Proactive and solution-oriented mindset

• Passion for automation and continuous improvement

• Strong collaboration and communication skills

• Ability to work independently and in a team

• Willingness to mentor and share knowledge

HARDSKILLS :

• Experience with Go or Python

• Strong scripting skills (Bash, Python)

• Hands-on experience with Linux systems (Ubuntu/Debian)

• Preferred hands-on experience with GPU & HPC infrastructure

• Knowledge of networking (VLAN/LAN, TCP/IP, DNS, BGP, load-balancing, IPv6, etc.)

• Familiarity with monitoring and logging tools (Prometheus, Grafana, Elastic, etc.)

• Comfortable with Infrastructure-as-Code (Ansible, Salt, AWX, etc.)

• Experience managing relational databases (MariaDB)

• Understanding of CI/CD pipelines (GitLab)

• Comfortable with English (written and spoken)

200 zł - 250 zł an hour