Lead Data Platform Engineer for Enterprise AI Data

Socket.dev; Foster City (CA); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Zoox is seeking a high-agency, hands-on Lead Data Platform Engineer to architect, optimize, scale and own the data foundation across enterprise and AI workloads. You will design a high-throughput data fabric, unify data across Zoox and downstream AI agents, and drive performance, governance and CI/CD pipelines to deliver secure, low-latency data foundations.

You will lead as the primary technical driver for the data platform, building scalable infrastructure, enforcing security standards like

Qualifications

• 10+ years of hands-on experience in Data Platform Engineering or Software Engineering.
• Deep expertise in scaling, query tuning, compute-resource allocation, and implementing efficient lifecycle policies.
• Experience implementing enterprise security standards, RBAC, AD/IAM roles and data masking with compliance familiarity (SOX, audit trails).
• Experience establishing enterprise data governance frameworks, automated schema evolution controls, data quality audits and observability.
• Hands-on experience building automated CI/CD pipelines and deployment testing for data assets.

Responsibilities

• Scaling self-healing data pipelines that handle schema evolution, detect anomalies and recover from failures with minimal manual intervention.
• Define and enforce company-wide data governance, access controls, automated data quality testing, and metadata management.
• Implement storage lifecycle strategies and query optimization to minimize compute while delivering high-throughput, low-latency data access for analytics and AI agents.
• Build automated CI/CD deployment templates, environment isolation, testing frameworks and version control standards for data assets.

Skills

Data Platform Engineering

RBAC

CI/CD Pipelines

Databricks

AWS EMR

Data Governance

Observability/Alerting

Terraform

EKS

Security Compliance

Tools

Terraform

EKS

Databricks

Active Directory/IAM

Job description

Zoox is seeking a high-agency, hands-on Lead Data Platform Engineer to architect, optimize, scale and own the data foundation across enterprise and AI workloads. You will design a high-throughput data fabric, unify data across Zoox and downstream AI agents, and drive performance, governance and CI/CD pipelines to deliver secure, low-latency data foundations.

You will lead as the primary technical driver for the data platform, building scalable infrastructure, enforcing security standards like