Senior Devops Engineer

SourcingXPress; Bengaluru; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

A global technology consultancy is seeking a Senior Cloud Infrastructure Engineer specializing in Data Platforms. The ideal candidate will implement scalable Azure cloud infrastructures and CI/CD pipelines while ensuring optimal performance with Databricks. Key qualifications include 5+ years of experience in DevOps, with strong expertise in Azure services and Databricks. This full-time role offers an impactful opportunity to drive digital innovation in a collaborative environment.

Qualifications

• 5+ years of experience in DevOps or Cloud Engineering roles.
• Proven track record with Azure services and Databricks.
• Strong scripting abilities in Shell/Python.

Responsibilities

• Architect and manage scalable Azure cloud infrastructure.
• Implement CI/CD pipelines for deployment.
• Collaborate with teams to optimize Databricks performance.

Skills

Azure Networking

DevOps

Databricks

Terraform

Python

Tools

Azure DevOps

GitHub Actions

Job description

Job Description

Company: Thoughtworks

Website: Visit Website

Business Type: Enterprise

Company Type: Product & Service

Business Model: B2B

Funding Stage: IPO/Public

Industry: Information Technology

Salary Range: ₹ 15-28 Lacs PA

Overview

Thoughtworks is a global technology consultancy that integrates strategy, design, and engineering to drive digital innovation. With over 30 years of experience, Thoughtworks helps enterprises modernize legacy systems, build scalable digital platforms, and deliver impactful software solutions. Known for its strong engineering culture and commitment to open-source, Thoughtworks partners with clients to solve complex business problems using cutting-edge technologies and agile practices.

What would you do here?

Senior Cloud Infrastructure Engineer for Data Platform. The ideal candidate will play a critical role in designing, implementing, and maintaining cloud infrastructure and CI/CD pipelines to support scalable, secure, and efficient data and analytics solutions. This role requires a strong understanding of cloud-native technologies, DevOps best practices, and hands-on experience with Azure and Databricks.

Responsibilities

• Cloud Infrastructure Design & Management: Architect, deploy, and manage scalable and secure cloud infrastructure on Microsoft Azure.
• Implement best practices for Azure Resource Management, including resource groups, virtual networks, and storage accounts.
• Optimize cloud costs and ensure high availability and disaster recovery for critical systems.
• Databricks Platform Management: Set up, configure, and maintain Databricks workspaces for data engineering, machine learning, and analytics workloads.
• Automate cluster management, job scheduling, and monitoring within Databricks.
• Collaborate with data teams to optimize Databricks performance and ensure seamless integration with Azure services.
• CI/CD Pipeline Development: Design and implement CI/CD pipelines for deploying infrastructure, applications, and data workflows using tools like Azure DevOps, GitHub Actions, or similar.
• Automate testing, deployment, and monitoring processes to ensure rapid and reliable delivery of updates.
• Monitoring & Incident Management: Implement monitoring and alerting solutions using tools like Dynatrace, Azure Monitor, Log Analytics, and Databricks metrics.
• Troubleshoot and resolve infrastructure and application issues, ensuring minimal downtime.
• Security & Compliance: Enforce security best practices, including identity and access management (IAM), encryption, and network security.
• Ensure compliance with organizational and regulatory standards for data protection and cloud operations.
• Collaboration & Documentation: Work closely with cross-functional teams, including data engineers, software developers, and business stakeholders, to align infrastructure with business needs; maintain comprehensive documentation for infrastructure, processes, and configurations.

Qualifications

Must Have Experience

• 5+ years of experience in DevOps or Cloud Engineering roles.
• Cloud - Azure: Networking, Key Vault, Az CLI, ADF, Databricks/Snowflake, ADLS, Azure Storage.
• DataBricks: Provisioning, Workspace Management, Secret Management, Networking, Pipelines Management, Databricks Bundles.
• IAC: Terraform, CI/CD Pipelines on GitHub, Shell/Python Scripting, REST API
• Databricks experience is mandatory.
• The candidate will be an individual contributor.

Nice To Have

Unity Catalog, Delta Lake Table Format, PySpark, Py Wheel, PostgreSQL Management

Soft Skills

• Strong problem-solving and analytical skills.
• Excellent communication and collaboration abilities.

What would you do here?

Senior Cloud Infrastructure Engineer for Data Platform. The ideal candidate will play a critical role in designing, implementing, and maintaining cloud infrastructure and CI/CD pipelines to support scalable, secure, and efficient data and analytics solutions. This role requires a strong understanding of cloud-native technologies, DevOps best practices, and hands-on experience with Azure and Databricks.

Job Details

• Location: Open to candidates with relevant Azure & Databricks experience.
• Employment Type: Full-time
• Reporting to: Engineering Lead