Principal Distributed Systems Engineer - Reliability

Comcast; Chicago (IL); On-site; USD 152,829 - 229,243; Full time

Job summary

Comcast, via FreeWheel, seeks a Principal Software Engineer to lead reliability, performance, and operational excellence of the ad tech platforms. You will design, operate, and troubleshoot large-scale distributed systems while owning monitoring, incident response, change management, and capacity planning.

Lead complex issues, automate workflows, and partner with teams to deliver scalable solutions. Role requires 10+ years in software engineering, 5+ years AWS experience, and expert skills in

Qualifications

• Requires 10+ years of professional software engineering experience.
• 5+ years experience with AWS cloud services.
• Expert-level coding, debugging, and troubleshooting skills.
• Proven ability to lead and mentor engineers in automation and reliability.
• Strong design and operation experience with Python/Go/Scala and distributed systems.
• Experience with data processing, Linux, networking, and CI/CD tooling.

Responsibilities

• Own production reliability, availability, latency, and performance of large-scale systems.
• Design, implement, and operate monitoring, alerting, observability solutions.
• Lead incident response, RCA, and post-incident reviews for reliability.
• Support stable ops during live events and releases.
• Drive automation to reduce toil and increase resilience.
• Collaborate with engineering teams to influence architecture for production readiness.
• Lead change management, capacity planning, and production readiness reviews.
• Champion security and secure configuration practices.
• Participate in on-call rotations and provide escalation support.

Skills

Distributed systems

Leadership

Troubleshooting

Mentoring engineers

Education

Bachelor's Degree

Tools

Python

Go

Scala

Docker

Kubernetes

Jenkins

Git

Ansible

Chef

Puppet

AWS

Job description

Comcast, via FreeWheel, seeks a Principal Software Engineer to lead reliability, performance, and operational excellence of the ad tech platforms. You will design, operate, and troubleshoot large-scale distributed systems while owning monitoring, incident response, change management, and capacity planning.

Lead complex issues, automate workflows, and partner with teams to deliver scalable solutions. Role requires 10+ years in software engineering, 5+ years AWS experience, and expert skills in