Data Delivery Platform Lead

Lightwheel; California (MO); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Medical, Dental, Vision insurance

401(k) with company match

Learning & Development budget

Relocation assistance

Job summary

Lightwheel is seeking a seasoned Data Platform Engineer to own end-to-end delivery of customer data programs. You will design specs, manage validation gates, and optimize throughput and costs across cloud-based data pipelines.

Responsibilities include building scalable adapters and orchestration, diagnosing bottlenecks, and guiding capacity planning for large-scale data hours. Fluency in English and Mandarin is valued for collaboration with diverse customers.

Qualifications

• 3+ years in software engineering, data infrastructure, distributed systems, ML/robotics infrastructure, or customer engineering.
• Strong hands-on engineering background (backend, data, infrastructure, or similar).
• Proficient in Python, APIs/SDKs, AWS/GCP, S3/GCS, Kubernetes, workflow orchestration, schema/lineage/versioning, retries/idempotency, and observability.

Responsibilities

• Own specs/schema management, validation, adapters, conversion, packaging, cloud transfer, SDK/API integration, retries/checkpointing, observability, and cost optimization.
• Translate requirements into versioned specs, define acceptance criteria, establish validation gates, manage throughput/risk/ETA, and ensure customer ingestion and reconciliation.
• Diagnose bottlenecks across SDK/API, schema/serialization, conversion, cloud throughput, rate limits, retries, customer ingestion, compute/storage, and cost.
• Own capacity planning across data-hours/day, compute, storage, bandwidth, conversion/API throughput, rate limits, failure rates, and infrastructure cost.
• Standardize delivery gates, state definitions, and change control. Lead the Data Delivery Engineering function over time.

Skills

Python

APIs/SDKs

AWS/GCP

S3/GCS

Kubernetes

Workflow orchestration

Schema/lineage/versioning

Observability

English

Mandarin

Job description

Lightwheel is seeking a seasoned Data Platform Engineer to own end-to-end delivery of customer data programs. You will design specs, manage validation gates, and optimize throughput and costs across cloud-based data pipelines.

Responsibilities include building scalable adapters and orchestration, diagnosing bottlenecks, and guiding capacity planning for large-scale data hours. Fluency in English and Mandarin is valued for collaboration with diverse customers.