Databricks Platform Engineer - Azure, IaC & CI/CD Leader

Tata Consultancy Services; Quincy (MA); Presencial; USD 100.000 - 117.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical coverage

401K plan

Performance bonus

Training reimbursement

Vacation & holidays

Descripción de la vacante

Tata Consultancy Services seeks an experienced platform/infra engineer to design, deploy, and manage Databricks workloads across Azure subscriptions, with IaC using Terraform and strong security controls.

You will build CI/CD pipelines with Azure DevOps, optimize costs, mentor teammates, and collaborate with data engineers to deliver scalable data platforms in a compliant, well-documented environment.

Formación

• 7+ years of platform or infra engineering, or DevOps experience.
• 2+ years hands-on Databricks infrastructure setup.
• 3+ years with Azure cloud services.
• 2+ years with Azure DevOps (Pipelines, Repos, Artifacts).
• Strong Infrastructure-as-Code experience with Terraform.
• Solid CI/CD knowledge and implementation.
• Experience with Linux/Unix and scripting (Bash, Python).
• Familiarity with Docker, Kubernetes, networking, security, and IAM in cloud environments.

Responsabilidades

• Design, deploy, and manage Databricks workspaces across environments.
• Implement IaC solutions using Terraform for Databricks resources.
• Establish security best practices, network isolation, and data governance.
• Configure cluster management, auto-scaling, and cost optimization.
• Build CI/CD pipelines with Azure DevOps for notebooks and configs.
• Develop runbooks and governance documentation.
• Mentor team members on Databricks and Azure DevOps practices.

Conocimientos

Databricks

Azure

Azure DevOps

Terraform

CI/CD

Linux/Unix

Docker

Kubernetes

Security & IAM

Networking

Educación

Bachelor's degree in Computer Science

Herramientas

Terraform Enterprise

Azure DevOps

Databricks

CI/CD tooling

Descripción del empleo

Tata Consultancy Services seeks an experienced platform/infra engineer to design, deploy, and manage Databricks workloads across Azure subscriptions, with IaC using Terraform and strong security controls.

You will build CI/CD pipelines with Azure DevOps, optimize costs, mentor teammates, and collaborate with data engineers to deliver scalable data platforms in a compliant, well-documented environment.