Senior Platform Engineer: Kubernetes + Spark & Cloud

Blueface Ltd; Chester (Delaware County); On-site; USD 140,000 - 190,000; Full time

Job summary

Comcast is seeking a Sr. Platform Engineer to build, manage, and optimize the infrastructure that runs large-scale data workloads. You will design systems for metrics collection with Prometheus and visualization with Grafana, ensuring robustness and cost efficiency.

The role involves Kubernetes-based Spark platforms, tooling automation with Python/Scala, and collaboration with data engineers and scientists to deliver reliable data objectives across on-prem and cloud environments.

Qualifications

• Bachelor's degree in computer science or a related field, or equivalent experience.
• 7+ years in a DevOps or Systems Engineering role.
• Expertise in Apache Spark and Spark architecture.

Responsibilities

• Architect and manage Spark platforms (Kubernetes clusters or cloud services like AWS EKS).
• Package Spark workloads via Docker/Kubernetes and integrate with orchestration systems.
• Deploy infrastructure via Terraform/Ansible and troubleshoot job failures.
• Write medium to complex SQL queries as needed.
• Implement and maintain monitoring/alerting with Prometheus and Grafana.
• Collaborate with data engineers/scientists to meet data objectives.

Skills

Spark architecture

Python / PySpark

Scala/Java

Linux scripting (Bash)

SQL

CI/CD tooling

Observability tools

Kubernetes

Terraform/Ansible

Networking

Education

Bachelor's degree in computer science or related field

Tools

Docker

Kubernetes

Terraform

Ansible

AWS

Azure

GCP

Prometheus

Grafana

Job description

Comcast is seeking a Sr. Platform Engineer to build, manage, and optimize the infrastructure that runs large-scale data workloads. You will design systems for metrics collection with Prometheus and visualization with Grafana, ensuring robustness and cost efficiency.

The role involves Kubernetes-based Spark platforms, tooling automation with Python/Scala, and collaboration with data engineers and scientists to deliver reliable data objectives across on-prem and cloud environments.