Lead Real-Time Events Engineer – High-Volume Pipelines

Zeta Global; Atlanta (GA); On-site; USD 200,000 - 210,000; Full time

Benefits offered by this job

Unlimited PTO

Excellent medical, dental, and vision

Employee Equity

Discounts, Wellness, Pet Insurance

Job summary

Zeta Global is seeking a Lead Software Engineer to join Real-Time Events (RTE). This is a highly hands-on IC role to design, build, and operate the ZMP real-time events pipeline handling high-volume data for marketing platform products.

Key duties include technical leadership, architecture ownership, and cross-team collaboration to meet SLAs. The role requires strong Python/Scala/Java skills and extensive experience with Kafka and AWS-based data pipelines.

Qualifications

• 8–10 years in software engineering with lead/staff exposure to event, streaming, or data-infrastructure systems.
• Proficient in event streaming (Kafka or equivalent), Python services/APIs (FastAPI), and pipeline processing (Spark/EMR).
• Experience designing and operating systems on AWS (S3, SQS/SNS, Lambda, RDS).
• Full lifecycle software development, from design to production, monitoring and on-call.
• Fluency in Python or substantial experience with Scala/Java.
• Experience with data stores in event pipelines (Postgres/MySQL, Redis, DynamoDB).
• Experience with orchestrators such as Apache Airflow.
• Strong communication to explain designs and trade-offs to partners.

Responsibilities

• Technical Leadership: design, implement, and launch production-ready event-pipeline features; own pipeline architecture.
• Innovation: evaluate new technologies for cost, latency, or operational gains and push to production.
• Engineering Collaboration: participate in architecture discussions and define stable interfaces with downstream consumers.
• Team Mentorship: mentor through code/design reviews and ensure production-worthy patterns.
• Product Collaboration: work with Product, Data, and ZMP teams to meet SLAs (latency, throughput, correctness).
• Infrastructure & Reliability: improve alerting, own on-call gaps, drive post-incident fixes and observability.

Skills

Kafka

Python

FastAPI

Spark/EMR

AWS

Scala

Java

PostgreSQL

MySQL

Redis

DynamoDB

Airflow

S3/SQS/SNS

Lambda

RDS

Tools

Kafka

FastAPI

Spark/EMR

Airflow

AWS

Job description

Zeta Global is seeking a Lead Software Engineer to join Real-Time Events (RTE). This is a highly hands-on IC role to design, build, and operate the ZMP real-time events pipeline handling high-volume data for marketing platform products.

Key duties include technical leadership, architecture ownership, and cross-team collaboration to meet SLAs. The role requires strong Python/Scala/Java skills and extensive experience with Kafka and AWS-based data pipelines.