Databricks And Snowflake Infrastructure Engineer

NTT DATA North America; Hyderabad; On-site; INR 4,000,000 - 8,000,000; Full time

Job summary

NTT DATA North America in Hyderabad seeks a senior Cloud/DevOps Engineer to design, build, and maintain Terraform IaC for automating Databricks and Snowflake deployments on AWS.

Deploy Databricks and Snowflake environments, configure Unity Catalog, implement secure AWS infrastructure, and lead CI/CD pipelines across dev, QA, and production. Strong governance, collaboration, and communication skills are essential.

Qualifications

• 7+ years of cloud/infra/platform engineering experience.
• 5+ years IaC with Terraform.
• 5+ years AWS experience.
• 3+ years Databricks on AWS deployment.
• 3+ years Snowflake deployment and RBAC.
• 3+ years CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, GitLab).
• 3+ years secure cloud architectures (encryption, identity, network isolation).
• 2+ years scripting with Python, Bash, or PowerShell.
• Experience in Agile delivery and architectural reviews.
• Strong client-facing communication skills.

Responsibilities

• Design, build, and maintain Terraform IaC for Databricks and Snowflake on AWS.
• Deploy and configure Databricks workspaces, Unity Catalog, and network settings.
• Configure Snowflake accounts, warehouses, RBAC, and data governance.
• Implement secure AWS infra (VPCs, IAM, KMS, Secrets Manager).
• Build CI/CD pipelines to automate provisioning and deployment.
• Collaborate with Cloud Architects and Security Engineers on standards.

Skills

Cloud engineering

DevOps engineering

Infrastructure engineering

Platform engineering

Architecture reviews

Stakeholder collaboration

Agile delivery

Tools

Terraform

AWS

Databricks

Snowflake

GitHub Actions

Azure DevOps

Jenkins

GitLab

KMS

Secrets Manager

Job description

Job Description

Day to Day Job Duties
Design, build, and maintain Terraform templates and Infrastructure as Code (IaC) frameworks to automate the deployment of Databricks and Snowflake platforms on AWS.
Deploy and configure Databricks workspaces, account-level settings, workspace networking, cluster policies, service principals, and Unity Catalog environments using Terraform and platform APIs.
Configure and validate Unity Catalog metastore architecture, catalog/schema structure, external locations, storage credentials, privilege models, and data governance controls.
Deploy and validate Snowflake accounts, virtual warehouses, databases, schemas, roles, warehouses, resource monitors, and role-based access control (RBAC) configurations.
Implement secure AWS infrastructure, including VPCs, PrivateLink, security groups, IAM roles, KMS encryption, Secrets Manager, and network segmentation to support Databricks and Snowflake deployments.
Build CI/CD pipelines to automate environment provisioning, configuration management, testing, and promotion across development, QA, and production environments.
Perform platform validation and operational readiness testing, including authentication, authorization, networking, connectivity, data access, encryption, monitoring, and disaster recovery capabilities.
Partner with Cloud Architects, Security Engineers, and Data Platform teams to establish deployment standards, reference architectures, and platform governance controls.
Troubleshoot infrastructure, connectivity, identity, Unity Catalog, and Snowflake security configuration issues.
Create reusable deployment accelerators, Terraform modules, platform blueprints, and operational runbooks to support enterprise-scale platform rollouts.
Basic Qualifications
Minimum 7+ years of experience in Cloud Engineering, DevOps Engineering, Infrastructure Engineering, or Platform Engineering.
Minimum 5+ years of hands‑on experience developing Infrastructure as Code (IaC) solutions using Terraform.
Minimum 5+ years of experience with AWS services, including VPCs, IAM, KMS, Secrets Manager, CloudTrail, networking, and cloud security.
Minimum 3+ years of experience deploying and administering Databricks on AWS, including workspace deployment, Unity Catalog, cluster policies, service principals, secrets management, and workspace networking.
Minimum 3+ years of experience deploying and administering Snowflake, including account setup, database architecture, warehouses, RBAC, data sharing, security policies, and resource governance.
Minimum 3+ years of experience implementing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, GitLab, or similar tools.
Minimum 3+ years of experience implementing secure cloud architectures, including encryption, identity management, secrets management, and network isolation.
Minimum 2+ years of experience developing automation and deployment scripts using Python, Bash, or PowerShell.
Experience validating platform readiness, security controls, operational processes, monitoring, logging, and compliance requirements for production deployments.
Experience implementing DevSecOps practices, infrastructure governance, automated policy enforcement, and security compliance controls.
Experience working in Agile delivery environments with sprint-based development and stakeholder collaboration.
Strong client‑facing communication skills with the ability to lead architecture reviews, deployment planning workshops, and technical validation sessions.
Preferred Qualifications
Experience deploying enterprise Databricks and Snowflake platforms supporting Data Engineering, Analytics, AI/ML, and governance workloads.
Experience implementing Unity Catalog governance models, multi-workspace architectures, and cross‑account AWS deployment patterns.
Experience configuring Snowflake network policies, private connectivity, SSO integration, SCIM provisioning, and advanced security features.
Experience supporting regulated financial services, banking, healthcare, or other highly governed environments.
AWS, Terraform, Databricks, and Snowflake certifications preferred.