Databricks & Snowflake Infrastructure Engineer

NTT DATA North America; Hyderabad; On-site; INR 3,500,000 - 6,000,000; Full time

Job summary

NTT DATA North America in Hyderabad seeks an expert Cloud Engineer to design, implement, and automate IaC for Databricks and Snowflake on AWS. You will build Terraform modules, validate Unity Catalog and RBAC, and implement secure networking across environments.

Lead CI/CD pipelines and platform governance, collaborating with Cloud Architects and Data Platform teams to ensure scalable, compliant deployments. Strong DevSecOps and Agile experience required.

Qualifications

• Minimum 7+ years of experience in Cloud Engineering, DevOps Engineering, Infrastructure Engineering, or Platform Engineering.
• Minimum 5+ years of hands-on experience developing Infrastructure as Code (IaC) solutions using Terraform.
• Minimum 5+ years of experience with AWS services, including VPCs, IAM, KMS, Secrets Manager, CloudTrail, networking, and cloud security.
• Minimum 3+ years of experience deploying and administering Databricks on AWS, including workspace deployment, Unity Catalog, cluster policies, service principals, secrets management, and workspace networking.
• Minimum 3+ years of experience deploying and administering Snowflake, including account setup, database architecture, warehouses, RBAC, data sharing, security policies, and resource governance.
• Minimum 3+ years of experience implementing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, GitLab, or similar tools.
• Minimum 3+ years of experience implementing secure cloud architectures, including encryption, identity management, secrets management, and network isolation.
• Minimum 2+ years of experience developing automation and deployment scripts using Python, Bash, or PowerShell.
• Experience validating platform readiness, security controls, operational processes, monitoring, logging, and compliance requirements for production deployments.
• Experience implementing DevSecOps practices, infrastructure governance, automated policy enforcement, and security compliance controls.
• Experience working in Agile delivery environments with sprint-based development and stakeholder collaboration.
• Strong client-facing communication skills with the ability to lead architecture reviews, deployment planning workshops, and technical validation sessions.

Responsibilities

• Design, build, and maintain Terraform templates and IaC frameworks to automate deployment of Databricks and Snowflake on AWS.
• Deploy and configure Databricks workspaces, Unity Catalog, and related security controls using Terraform and platform APIs.
• Configure Unity Catalog metastore, catalog/schema, external locations, storage credentials, and governance models.
• Deploy and manage Snowflake accounts, databases, RBAC, and resource governance configurations.
• Implement secure AWS infrastructure including VPCs, PrivateLink, IAM roles, KMS, and Secrets Manager.
• Build CI/CD pipelines to automate provisioning, configuration, testing, and promotion across environments.
• Perform platform validation and readiness testing for authentication, networking, data access, and disaster recovery.
• Collaborate with Cloud Architects, Security Engineers, and Data Platform teams on standards and governance.
• Troubleshoot infrastructure, connectivity, identity, Unity Catalog, and Snowflake security issues.
• Create reusable deployment accelerators, Terraform modules, and platform runbooks for large-scale rollouts.

Skills

Terraform

AWS

Databricks

Snowflake

CI/CD

GitHub Actions

Python

Bash

PowerShell

Unity Catalog

Security

Networking

RBAC

Secret Management

Encryption

Agile

Tools

GitHub Actions

Azure DevOps

Jenkins

Job description

Day to Day Job Duties

• Design, build, and maintain Terraform templates and Infrastructure as Code (IaC) frameworks to automate the deployment of Databricks and Snowflake platforms on AWS.
• Deploy and configure Databricks workspaces, account-level settings, workspace networking, cluster policies, service principals, and Unity Catalog environments using Terraform and platform APIs.
• Configure and validate Unity Catalog metastore architecture, catalog/schema structure, external locations, storage credentials, privilege models, and data governance controls.
• Deploy and validate Snowflake accounts, virtual warehouses, databases, schemas, roles, warehouses, resource monitors, and role-based access control (RBAC) configurations.
• Implement secure AWS infrastructure, including VPCs, PrivateLink, security groups, IAM roles, KMS encryption, Secrets Manager, and network segmentation to support Databricks and Snowflake deployments.
• Build CI/CD pipelines to automate environment provisioning, configuration management, testing, and promotion across development, QA, and production environments.
• Perform platform validation and operational readiness testing, including authentication, authorization, networking, connectivity, data access, encryption, monitoring, and disaster recovery capabilities.
• Partner with Cloud Architects, Security Engineers, and Data Platform teams to establish deployment standards, reference architectures, and platform governance controls.
• Troubleshoot infrastructure, connectivity, identity, Unity Catalog, and Snowflake security configuration issues.
• Create reusable deployment accelerators, Terraform modules, platform blueprints, and operational runbooks to support enterprise-scale platform rollouts.

Basic Qualifications

• Minimum 7+ years of experience in Cloud Engineering, DevOps Engineering, Infrastructure Engineering, or Platform Engineering.
• Minimum 5+ years of hands-on experience developing Infrastructure as Code (IaC) solutions using Terraform.
• Minimum 5+ years of experience with AWS services, including VPCs, IAM, KMS, Secrets Manager, CloudTrail, networking, and cloud security.
• Minimum 3+ years of experience deploying and administering Databricks on AWS, including workspace deployment, Unity Catalog, cluster policies, service principals, secrets management, and workspace networking.
• Minimum 3+ years of experience deploying and administering Snowflake, including account setup, database architecture, warehouses, RBAC, data sharing, security policies, and resource governance.
• Minimum 3+ years of experience implementing CI/CD pipelines using GitHub Actions, Azure DevOps, Jenkins, GitLab, or similar tools.
• Minimum 3+ years of experience implementing secure cloud architectures, including encryption, identity management, secrets management, and network isolation.
• Minimum 2+ years of experience developing automation and deployment scripts using Python, Bash, or PowerShell.
• Experience validating platform readiness, security controls, operational processes, monitoring, logging, and compliance requirements for production deployments.
• Experience implementing DevSecOps practices, infrastructure governance, automated policy enforcement, and security compliance controls.
• Experience working in Agile delivery environments with sprint-based development and stakeholder collaboration.
• Strong client-facing communication skills with the ability to lead architecture reviews, deployment planning workshops, and technical validation sessions.

Preferred Qualifications

• Experience deploying enterprise Databricks and Snowflake platforms supporting Data Engineering, Analytics, AI/ML, and governance workloads.
• Experience implementing Unity Catalog governance models, multi-workspace architectures, and cross-account AWS deployment patterns.
• Experience configuring Snowflake network policies, private connectivity, SSO integration, SCIM provisioning, and advanced security features.
• Experience supporting regulated financial services, banking, healthcare, or other highly governed environments.
• AWS, Terraform, Databricks, and Snowflake certifications preferred.