Principal Data Engineer: Real-Time Ad Platform Architect

Walmart Inc.; Sunnyvale (CA); On-site; USD 143,000 - 286,000; Full time

Benefits offered by this job

Discount Card

10% off Walmart products

Live Better U

Medical, dental, vision

Job summary

Walmart Inc. in Sunnyvale, CA seeks a Principal Engineer to architect scalable data systems processing billions of advertising and customer signals across real-time, near-real-time, micro-batch, and batch workloads.

The role ensures low latency, high throughput, resilience, replayability, idempotency, and cost-efficient scaling. You will unify advertising data across campaigns, identity, audiences, measurement, optimization, CRM, and advertiser lifecycle, building multi-tenant platforms with

Qualifications

• Bachelor’s degree in Computer Science and 5 years' experience in software engineering or related field.
• Option 2: 7 years' experience in software engineering or related field.
• Master's degree in Computer Science and 3 years' experience in software engineering or related field.
• 4 years' experience in data engineering, database engineering, business intelligence, or business analytics.

Responsibilities

• Lead the architecture of real-time, large-scale advertising and customer data platforms processing billions of signals with predictable latency, resilience, replayability, and cost efficiency.
• Define when workloads use streaming, near-real-time, micro-batch, or batch patterns while modernizing legacy pipelines.
• Provide technical leadership across the full advertising lifecycle, including events, identity, audiences, campaigns, measurement, optimization, CRM, and marketing data.
• Build reusable, multi-tenant, configuration-driven platforms with standardized schemas, contracts, observability, privacy, and deployment.
• Establish governed agentic data capabilities for discovery, pipeline creation, monitoring, diagnosis, optimization, onboarding, and AI-ready products with guardrails.

Skills

Billion-scale distributed

Real-time systems

Spark

Flink

Kafka

Streaming

Orchestration

Education

Bachelor’s degree in Computer Science

8+ years software/data engineering

Tools

BigQuery

Dataproc

Dataflow

Pub/Sub

Airflow

Job description

Walmart Inc. in Sunnyvale, CA seeks a Principal Engineer to architect scalable data systems processing billions of advertising and customer signals across real-time, near-real-time, micro-batch, and batch workloads.

The role ensures low latency, high throughput, resilience, replayability, idempotency, and cost-efficient scaling. You will unify advertising data across campaigns, identity, audiences, measurement, optimization, CRM, and advertiser lifecycle, building multi-tenant platforms with