Site Reliability Engineer – 24x7 SaaS, Observability

TherapyNotes, LLC; Philadelphia (Philadelphia County); On-site; USD 110,000 - 130,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

Retirement plan

Profit sharing

Training budget

Mentorship program

Onboarding program

Open work environment

Job summary

TherapyNotes LLC is seeking a Site Reliability Engineer to strengthen the reliability of our 24×7 SaaS platform. You will collaborate with software, infrastructure, and security teams to set reliable performance goals, reduce toil, and ensure services remain maintainable throughout their lifecycle.

You will own Datadog visibility, drive incident management, and help implement automated validation, rollback, and resilience testing while adhering to HIPAA and security policies.

Qualifications

• BS degree in Information Systems, Engineering, or equivalent experience.
• 5+ years of engineering experience in Systems/DevOps/SRE.
• Experience with cloud compute/storage/networking; Azure and Kubernetes preferred.
• Strong Linux fundamentals and networking; troubleshooting distributed systems.
• Observability experience with Datadog; Prometheus/Grafana/New Relic valuable.
• Scripting with Bash/PowerShell/Python; IaC and configuration management.
• On-call rotations, incident response, root-cause analysis and post-incident improvement.
• Experience in Agile/DevOps environments and ITSM practices.
• Prior software development or code-behavior investigation is a plus.

Responsibilities

• Own and improve Datadog visibility across metrics, logs, traces, dashboards, alerts, and SLIs/SLOs.
• Design and maintain high-availability, high-throughput systems for a 24x7 SaaS platform.
• Partner with service owners to set reliable performance targets and alerting.
• Lead incident management as needed, coordinating triage, restoration, and RCA.
• Collaborate with dev teams to diagnose issues across infra and application layers.
• Improve deployment safety with automated validation, rollback, and resilience testing.
• Ensure newly introduced systems are maintainable by both dev and ops teams.
• Provide escalated technical guidance and on-call coverage as required.
• Ensure compliance with security, HIPAA, and operating policies.
• Eliminate repetitive toil using Bash, PowerShell, Python; manage IaC with Terraform/OpenTofu and Ansible.

Skills

Linux fundamentals

Kubernetes

Datadog

Scripting (Bash/Python)

Incident response

Agile/DevOps

Distributed systems

Cloud engineering

Code-level debugging

Education

BS in Information Systems/Engineering

Tools

Datadog

Terraform/OpenTofu

Ansible

Prometheus

Grafana

New Relic

Job description

TherapyNotes LLC is seeking a Site Reliability Engineer to strengthen the reliability of our 24×7 SaaS platform. You will collaborate with software, infrastructure, and security teams to set reliable performance goals, reduce toil, and ensure services remain maintainable throughout their lifecycle.

You will own Datadog visibility, drive incident management, and help implement automated validation, rollback, and resilience testing while adhering to HIPAA and security policies.