Senior Data Platform Engineer - Real-Time Analytics

Unity; Mountain View (CA); On-site; USD 210,000 - 273,000; Full time

Benefits offered by this job

Health insurance

Stock ownership

Generous vacation and personal days

Commuting subsidy

Job summary

Unity is seeking a Senior Software Engineer to design and implement distributed data systems powering near real-time analytics. You will own high-throughput data pipelines, streaming processing, and a gRPC-based modernization initiative, while ensuring data correctness and low latency.

You will build and operate ad event processing, data health monitoring, and batch pipelines, collaborating with ML and Reporting teams to deliver timely, accurate signals across internal and external customers.

Qualifications

• Strong foundation in distributed systems and systems design.
• Hands-on experience building and operating large-scale data processing systems.
• Deep understanding of streaming concepts: exactly-once semantics, watermarking and event-time processing, stateful stream processing, checkpointing and recovery, and backpressure handling.
• Production experience with frameworks such as Apache Flink, Spark, Kafka, or similar technologies.
• Proficiency in Python, Java, or Scala.
• Experience with workflow orchestration tools such as Airflow for stream and batch coordination
• Strong understanding of cloud-native architectures and distributed infrastructure including Kubernetes, containerization, and cloud platforms.

Responsibilities

• Own the end-to-end attribution pipeline for Unity's ad ecosystem.
• Build and operate real-time ad event processing at scale.
• Lead architectural modernization with a gRPC-based service migration.
• Improve low-latency data services and the persistence layer across ad lifecycle.
• Build and maintain ad serving infrastructure including logging, tracing, and security.
• Drive real-time data health monitoring and batch data pipelines for BigQuery.
• Collaborate with ML, Reporting, and external partners to ensure timely signal reporting.

Skills

Distributed systems

Streaming

Large-scale data processing

Python/Java/Scala

Kafka

Flink/Spark

Airflow

Kubernetes

Cloud platforms

Tools

Kafka

Flink

Spark

Airflow

Kubernetes

Job description

Unity is seeking a Senior Software Engineer to design and implement distributed data systems powering near real-time analytics. You will own high-throughput data pipelines, streaming processing, and a gRPC-based modernization initiative, while ensuring data correctness and low latency.

You will build and operate ad event processing, data health monitoring, and batch pipelines, collaborating with ML and Reporting teams to deliver timely, accurate signals across internal and external customers.