Databricks Platform Engineer - AWS | Terraform | CI/CD

Tata Consultancy Services Limited; Marlborough (MA); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Medical Coverage

Parental Leaves

401K Plan

Certification & Training Reimbursement

Vacation & Holidays

Legal & Financial Assistance

Job summary

Tata Consultancy Services Limited is seeking an Enterprise Databricks Data Platform Administrator to implement, administer, and maintain the Databricks platform on AWS. You will provide operational support to data engineering, data science, and application teams, ensuring secure access and optimized performance.

The role focuses on environment setup, user/group management, IAM, and Unity Catalog, with strong emphasis on automation and data integration across warehouses and pipelines.

Qualifications

• Experience administering Databricks on AWS.
• Proficient with Terraform,CI/CD pipelines and automation.
• Strong knowledge of IAM, networking, and security controls.
• Familiar with Unity Catalog and data pipelines.
• Experience with SQL and PySpark in cloud data environments.

Responsibilities

• Enterprise Databricks Data Platform Administrator.
• Implement, administer, and maintain the Databricks platform on AWS while providing operational support to data engineering, data science, and application teams.

Skills

Databricks Admin

Terraform

AWS Cloud

MLflow

Workflows

Asset Bundles

IAM

VPC

Private Endpoints

S3

SQL PySpark

dbx CLI

Environment Setup

User & Groups

Access Control

Networking

Cluster Mgmt

Troubleshooting

Backup Recovery

Rest APIs

Unity Catalog

Data Warehouses

Data Pipelines

CI/CD

Tools

Databricks

dbx CLI

Job description

Tata Consultancy Services Limited is seeking an Enterprise Databricks Data Platform Administrator to implement, administer, and maintain the Databricks platform on AWS. You will provide operational support to data engineering, data science, and application teams, ensuring secure access and optimized performance.

The role focuses on environment setup, user/group management, IAM, and Unity Catalog, with strong emphasis on automation and data integration across warehouses and pipelines.