Cloud Data Platform Lead: Databricks & AWS

Tata Consultancy Services; Irvine (CA); On-site; USD 110,000 - 140,000; Full time

Job summary

Tata Consultancy Services in Irvine, CA seeks a Data Platform Engineering Lead to architect, build, and manage enterprise-scale cloud-native data platforms for Asset Management functions. You will oversee platform engineering, DevOps enablement, and reliability across the enterprise data ecosystem.

Responsibilities include defining platform strategy, implementing Lakehouse architectures with Delta, managing Databricks, Terraform, and CI/CD pipelines, and driving SRE practices for performance,

Qualifications

• Expertise in Databricks and AWS Cloud required.
• Strong background in platform engineering and DevOps practices.
• Experience with data platform governance and cost optimization.

Responsibilities

• Lead the design, implementation, and management of enterprise data platforms.
• Define platform engineering strategy aligned with enterprise standards.
• Establish reusable platform frameworks, accelerators, and engineering best practices.
• Drive cloud-native modernization across data and analytics ecosystems.
• Own platform lifecycle management, scalability, availability, and reliability.
• Lead Databricks platform architecture and administration.
• Design Lakehouse architectures leveraging Delta Lake.
• Manage Databricks Workflows, Delta Live Tables, Unity Catalog, MLflow, and security controls.
• Implement CI/CD pipelines and IaC practices with Terraform.
• Enable GitOps and improve deployment velocity and reliability.
• Provide self-service platform capabilities for engineering teams.
• Define platform SLAs/SLOs and monitor observability and incidents.

Skills

Databricks

dbt

AWS Cloud

Terraform

Python

DevOps

Platform Engineering

Data Operations

Tools

GitHub Actions

GitLab CI/CD

Jenkins

Azure DevOps

Terraform

Docker

Kubernetes

Job description

Tata Consultancy Services in Irvine, CA seeks a Data Platform Engineering Lead to architect, build, and manage enterprise-scale cloud-native data platforms for Asset Management functions. You will oversee platform engineering, DevOps enablement, and reliability across the enterprise data ecosystem.

Responsibilities include defining platform strategy, implementing Lakehouse architectures with Delta, managing Databricks, Terraform, and CI/CD pipelines, and driving SRE practices for performance,