Senior Reliability Engineer (Remote)

FashionUnited; Menomonee Falls (WI); Remote; USD 120,000 - 150,000; Full time

Job summary

Kohl’s in Wisconsin seeks an experienced Senior Reliability Engineer to ensure resilience and availability of systems and applications. You will collaborate with development teams, influence architecture, and implement robust monitoring and failover mechanisms.

You will lead incident response, root cause analyses, and drive automation to reduce toil. The role requires multi-region troubleshooting, experience with cloud platforms, and mentoring other engineers.

Qualifications

• Bachelor’s degree or equivalent in MIS, Computer Science or related field.
• 4+ years of experience in software development.
• Proficient in Java, Python, Go or Node.js.
• Strong knowledge of systems architecture, OS internals and networks.
• Knowledge of application design patterns, event-driven architecture, database schemas, and testing strategies.
• Experience with multi-region troubleshooting and performance tuning.
• Experience with cloud platforms (GCP, AWS, or Azure).
• Experience with monitoring techniques and tools like CloudWatch, Grafana, Prometheus, OpenTelemetry.

Responsibilities

• Drive error budget and SLO adoption across products.
• Drive incident response, root cause analysis, and preventative measures for reliability.
• Establish practices to elevate operational excellence through automation and improvements.
• Follow software lifecycle to drive reliability and observability across domains.
• Identify toil and implement automation and risk reduction.
• On-call rotation for production incidents and RCAs to drive continuous improvements.
• Proactively identify failures using chaos engineering ideas like edge cases and design reviews.
• Advise on capacity planning and assess system behavior and consumption.
• Collaborate with product managers to prioritize reliability work (SLIs/SLOs, error budgets).
• Mentor and assist engineers on the team.
• Additional tasks may be assigned.

Skills

Java

Python

Go

Node.js

Systems architecture

OS internals

Networking fundamentals

Event-driven architecture

Design patterns

Multi-region troubleshooting

Cloud platforms

Monitoring tools

Containerization

Terraform/OpenTofu

Education

Bachelor's Degree or equivalent in MIS, Computer Science or related field

Tools

Docker

Kubernetes

CloudWatch

Grafana

Prometheus

OpenTelemetry

Job description

As Senior Reliability Engineer, you will ensure the resilience and availability of Kohl’s systems and applications, collaborate closely with development teams, contribute to architectural designs, conduct risk assessments and design for failure, and implement robust monitoring and failover mechanisms.

What You’ll Do

• Drive error budget and Service Level Objective (SLO) adoption across products
• Drive incident response efforts, perform root cause analysis and implement preventative measures to enhance system reliability
• Establish consistent practices that elevate Kohl’s operational excellence through automation and process improvements
• Follow software lifecycle and drive reliability, observability, and efficiency across product teams within an assigned domain
• Identify repeated toil and find opportunities for automation and risk reduction
• On-call on a rotation to respond to production incidents and conduct blameless retros and root-cause analyses (RCAs) to drive a culture of continuous improvements
• Proactively identifies failures before they cause outages using chaos engineering techniques such as edge cases, failure modes and design review
• Advise on capacity planning and provide continuous assessments on systems behavior and consumption
• Work with product managers to identify and prioritize work for reliability best practices (i.e., leveraging SLIs/SLOs/Error Budgets)
• Mentors and assists engineers on the team
• Additional tasks may be assigned

What Skills You Have

Required

• Bachelor's Degree or equivalent in MIS, Computer Science or related field
• 4+ years of experience in software development
• Strong programming skills in one or more languages (Java, Python, Go or Node.js)
• In-depth knowledge of systems architecture, operating system internals and network fundamentals
• In-depth knowledge of application design patterns, event-driven architecture, database schemas, and testing strategies
• Experience with multi-region application troubleshooting and performance tuning
• Working experience with one cloud platform (GCP, AWS, or Azure)
• Working experience with monitoring techniques and tools (e.g., CloudWatch, Grafana, Prometheus, OpenTelemetry, Tracing)

Preferred

• In-depth knowledge of containerization and container orchestration (e.g., Docker, Kubernetes, Rancher)
• Experience with one or more configuration management systems (e.g., Chef, Ansible, Puppet)
• Passion for and experience with AI and ML methodologies (MLOps)
• Experience writing Infrastructure as code (e.g., Terraform, OpenTofu)