Lead Big Data & Streaming Platform Engineer

Disney Entertainment and ESPN Product & Technology Careers; San Francisco (CA); Vor Ort; USD 173.000 - 232.000; Vollzeit

Zusammenfassung

Disney Entertainment and ESPN Technology in San Francisco seeks a Lead Software Engineer to advance big data and backend services. You will own features for a large-scale data platform, help build cloud-based infrastructures for batch and streaming data, and push for high performance and reliability across distributed services.

The role emphasizes collaboration with researchers, product teams, and SDET engineers in a fast-paced, innovative environment, leveraging AWS, Terraform, Kubernetes, and

Qualifikationen

• Bachelor’s degree in Computer Science, Electronics Engineering, or related field.
• 7+ years of professional programming and design experience in Scala, Java, Python, etc.
• 3+ years of big data development with Databricks, Spark, Hive, SingleStore, Airflow, and AWS.
• Strong knowledge of system and application design/architecture.
• Experience processing large data at petabyte scale.
• Experience with cloud infrastructure technologies (Terraform, Kubernetes, Spinnaker).
• Passion for technology and interdisciplinary collaboration.
• Strong communication and project leadership experience.

Aufgaben

• Contribute to a team of big data and backend engineers to deliver high value projects.
• Build components of large-scale data platform for batch and real-time processing.
• Create next-gen cloud-based big data infrastructure for batch and streaming applications.
• Balance performance, scalability and reusability in designs.
• Advocate engineering best practices including CI/CD, code reviews, and automated tests.
• Collaborate with researchers to productize innovations at scale.
• Work with program managers, product managers, SDET, and researchers in an open environment.

Kenntnisse

Scala

Java

Python

Big data

Cloud architecture

Communication

Ausbildung

Bachelor's degree in Computer Science or related field

Tools

Databricks

Spark

Hive

SingleStore

Airflow

AWS

Terraform

Kubernetes (K8S)

Spinnaker

Grafana

Datadog

React/Vue/Angular

Jobbeschreibung

Disney Entertainment and ESPN Technology in San Francisco seeks a Lead Software Engineer to advance big data and backend services. You will own features for a large-scale data platform, help build cloud-based infrastructures for batch and streaming data, and push for high performance and reliability across distributed services.

The role emphasizes collaboration with researchers, product teams, and SDET engineers in a fast-paced, innovative environment, leveraging AWS, Terraform, Kubernetes, and