Cloud-Native Data Platform Lead (Databricks & AWS)

Ventures Unlimited Inc; Irvine (CA); On-site; USD 180,000 - 280,000; Full time

Job summary

Ventures Unlimited Inc in Irvine, CA seeks an EDO Platform Engineering Lead to architect, build, and manage an enterprise-scale cloud-native data platform for Asset Management functions.

You will lead platform engineering, infrastructure automation, DevOps enablement, platform reliability, and security across the Enterprise Data Office, leveraging Databricks, AWS, Terraform, and Python to support analytics, reporting, regulatory compliance, and investment operations.

Qualifications

• Extensive experience architecting and operating enterprise data platforms for financial services.
• Deep expertise in Databricks, AWS, Terraform and Python across large-scale data workloads.
• Proven ability to lead platform engineering, DevOps enablement, and SRE practices.

Responsibilities

• Lead design, implementation and management of enterprise data platforms.
• Define platform engineering strategy aligned with enterprise standards.
• Establish reusable platform frameworks, accelerators and best practices.
• Drive cloud-native modernization across data and analytics ecosystems.
• Own platform lifecycle, scalability, availability and reliability.
• Lead Databricks platform architecture and administration.
• Design Lakehouse architecture leveraging Delta Lake.
• Manage Databricks Workflows, DLT, Unity Catalog, MLflow and streaming.
• Implement IaC, governance and CI/CD pipelines.
• Support self-service platform capabilities and API integrations.

Skills

Databricks

dbt

AWS Cloud

Terraform

Python

DevOps

Platform Engineering

Data Operations

Tools

Databricks Workflows

Delta Live Tables

Unity Catalog

MLflow

Structured Streaming

Cluster Policies

Security and Access Controls

S3

ECS

EKS

Lambda

Glue

CloudWatch

IaC

GitOps

CI/CD

Job description

Ventures Unlimited Inc in Irvine, CA seeks an EDO Platform Engineering Lead to architect, build, and manage an enterprise-scale cloud-native data platform for Asset Management functions.

You will lead platform engineering, infrastructure automation, DevOps enablement, platform reliability, and security across the Enterprise Data Office, leveraging Databricks, AWS, Terraform, and Python to support analytics, reporting, regulatory compliance, and investment operations.