Lead Real-Time Data Streaming Engineer

zetaglobal; United States; Remote; USD 180,000 - 240,000; Full time

Benefits offered by this job

Flexible PTO

Medical, dental, and vision coverage

Employee equity

Wellness classes

Discounts

Pet insurance

Job summary

zetaglobal in the United States is seeking a senior software engineering leader to own architecture and production delivery for a real-time event pipeline. You will mentor engineers, drive latency, throughput, and data quality targets, and partner with product and data teams to translate requirements into reliable high-volume data ingestion and processing services.

The role emphasizes on-call ownership and architectural excellence.

Qualifications

• Eight to ten years of software engineering experience including lead or staff-level work on event/data infrastructure.
• Production experience with event streaming such as Kafka, Python services and APIs, and pipeline processing tools such as Spark or EMR.
• Ability to design, deploy, and operate systems on AWS (S3, SQS/SNS, Lambda, RDS).
• Fluency in Python or substantial experience with Scala and Java, plus familiarity with databases such as Postgres/MySQL/Redis/DynamoDB.

Responsibilities

• Design, build, and launch event pipeline features, owning architecture for the areas you lead.
• Assess technologies for improvements in latency, cost, or operability and implement in production.
• Define stable interfaces with downstream data consumers and collaborate on architecture and pipelines.
• Mentor engineers through design reviews and implementation patterns.
• Collaborate with product, data, and consumer teams to meet latency and throughput targets.
• Improve instrumentation, alerting, on-call readiness, and runbooks.

Skills

Leadership

Event streaming

Kafka

Python

Scala/Java

AWS

Data stores

System design

Monitoring

Tools

Kafka

Spark

EMR

Airflow

S3

Lambda

RDS

PostgreSQL

Job description

zetaglobal in the United States is seeking a senior software engineering leader to own architecture and production delivery for a real-time event pipeline. You will mentor engineers, drive latency, throughput, and data quality targets, and partner with product and data teams to translate requirements into reliable high-volume data ingestion and processing services.

The role emphasizes on-call ownership and architectural excellence.