Data Platform Lead — Databricks & AWS

Innocean; Huntington Beach (CA); Hybrid; USD 150,000 - 170,000; Full time

Benefits offered by this job

Medical plans

Dental & Vision

401k match

Wellness reimbursement

Disability & life insurance

Generous PTO

On-site barista

Oceanfront campus

Job summary

INNOCEAN USA is seeking a Data Engineering Manager in Huntington Beach to own the Databricks platform, drive batch and real-time data pipelines, and design a robust Lakehouse architecture with Delta Lake and Unity Catalog.

You will lead and grow the data engineering team, collaborate with Analytics, BI, and client teams, enforce CI/CD, code reviews, and observability practices, and ensure high-quality data and cost-conscious cloud operations.

Qualifications

• 5+ years of data engineering experience
• 2+ years of people leadership or management
• Deep Databricks expertise: Workflows, Delta Lake, Unity Catalog, platform administration
• Strong Spark experience: PySpark, Spark SQL
• Experience with cloud infrastructure (AWS/GCP/Azure) and Databricks integrations
• Excellent communication and cross-functional collaboration skills

Responsibilities

• Own Databricks platform strategy and administration
• Lead batch and real-time data pipelines with PySpark and Databricks Workflows
• Architect and maintain Lakehouse with Delta Lake and Unity Catalog
• Establish data quality, monitoring, and lineage across pipelines
• Mentor and develop data engineering team; partner with Analytics/BI
• Drive onboarding, documentation, training, and observability practices

Skills

Leadership & people management

Data engineering

Spark / PySpark

Databricks platform

Cloud platforms (AWS/GCP/Azure)

Communication

Tools

Databricks

Unity Catalog

Delta Lake

Spark SQL

Workflows / Airflow

Job description

INNOCEAN USA is seeking a Data Engineering Manager in Huntington Beach to own the Databricks platform, drive batch and real-time data pipelines, and design a robust Lakehouse architecture with Delta Lake and Unity Catalog.

You will lead and grow the data engineering team, collaborate with Analytics, BI, and client teams, enforce CI/CD, code reviews, and observability practices, and ensure high-quality data and cost-conscious cloud operations.