Platform Architect-Data Platforms

Tata Consultancy Services; Irvine (CA); On-site; USD 150,000 - 240,000; Full time

Job summary

Tata Consultancy Services in Irvine, CA is seeking a Platform Architect - Data Platforms to design, build and govern enterprise-scale cloud-native data platforms supporting asset management analytics and reporting.

The role focuses on Databricks, dbt and AWS, leveraging Terraform and Python to deliver scalable, secure, and highly available data ecosystems. You will drive platform reliability, security, and operational excellence across the Enterprise Data Office.

Qualifications

• Experience architecting enterprise-scale cloud-native data platforms.
• Strong knowledge of Databricks, dbt, and Delta Lake.
• Proven ability to design scalable data pipelines and governance.

Responsibilities

• Lead design and management of enterprise data platforms.
• Define platform engineering strategy and standards.
• Implement reusable platform frameworks and accelerators.
• Drive cloud-native modernization across data and analytics.
• Oversee CI/CD pipelines and IaC governance.

Skills

Databricks

dbt

Airflow

PySpark

Astronomer

DevOps

Platform engineering

Data operations

SRE practices

Tools

AWS Cloud

Terraform

Python

GitHub Actions

GitLab CI/CD

Jenkins

Azure DevOps

Docker

Kubernetes

S3

ECS

EKS

Lambda

Delta Lake

Delta Live Tables

Unity Catalog

MLflow

CloudWatch

Job description

Job DescriptionPlatform Architect - Data PlatformsMust Have Technical/Functional SkillsData Bricks , DBT ,Airflow PySpark, AstronomerRoles & ResponsibilitiesWe are seeking a highly skilled Platform Engineering Lead to architect, build, and manage enterprise-scale cloud-native data platforms supporting Asset Management business functions. The role will lead platform engineering,infrastructure automation, DevOps enablement, platform reliability, security, and operational excellence across the Enterprise Data Office (EDO).The ideal candidate will have deep expertise in Databricks, dbt, AWS Cloud, Terraform, Python, DevOps, Platform Engineering, and Data Operations, with strong experience supporting investment management organizations.This role is responsible for establishing and managing a scalable, secure, and highly available data platform that supports analytics, reporting, regulatory compliance, portfolio management, risk management, and investment operations.Key Responsibilities

• Lead the design, implementation, and management of enterprise data platforms.
• Define platform engineering strategy aligned with EDO and enterprise architecture standards.
• Establish reusable platform frameworks, accelerators, and engineering best practices.
• Drive cloud-native modernization initiatives across data and analytics ecosystems.
• Own platform lifecycle management, scalability, availability, and reliability.
• Lead enterprise-wide Databricks platform architecture and administration.
• Design and implement Lakehouse architecture leveraging Delta Lake.
• Manage: Databricks Workflows ,Delta Live Tables (DLT) ,Unity Catalog ,MLflow ,Structured Streaming ,Cluster Policies ,Security and Access Controls.
• Optimize platform performance and cost efficiency.
• Build governance controls across development, test, and production environments
• Lead cloud engineering activities using AWS services:S3 ,ECS,EKS,Lamda .Glue ,Cloudwatch
• Infrastructure as a Code (IaC)
• Build reusable Terraform modules.
• Automate environment provisioning.
• Implement infrastructure standardization and governance.
• Maintain infrastructure version control.
• Ensure compliance through Infrastructure-as-Code practices.
• Design and implement CI/CD pipelines.
• Automate deployment and release management processes.
• Enable Infrastructure-as-Code and GitOps methodologies.
• Improve deployment velocity and reliability.
• Support engineering teams with self-service platform capabilities.
• GitHub Actions ,GitLab CI/CD ,Jenkins ,Azure DevOps ,Terraform ,Docker ,Kubernetes
• Support API integrations and operational workflows.
• Establish Site Reliability Engineering (SRE) practices.
• Define platform SLAs, SLOs, and operational metrics.
• Lead platform monitoring, observability, and incident management.
• Drive root cause analysis and preventive actions.

Salary Range- $150,000-$240,000 a year