Cloud Engineer - Data Platforms

AVEVA; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Benefits offered by this job

Gratuity

Medical and accidental insurance

Education assistance program

Home office set up support

Job summary

AVEVA is seeking a Cloud Engineer for its Data Platforms team, located in Bengaluru, India. This role involves improving the delivery and operational reliability of data and AI workloads using Azure Databricks.

The ideal candidate will have strong experience in cloud platform engineering, particularly with Azure and Databricks, and will focus on pipeline reliability and automation in a hybrid working model.

Benefits include medical insurance, generous leave entitlement, and education assistance.

Qualifications

• Strong hands-on experience operating Azure Databricks in enterprise settings.
• Comfortable with automation, CI/CD, IaC, and operational best practices.
• Working knowledge of Spark and Delta Lake.

Responsibilities

• Build and operate Databricks workspaces and clusters.
• Support and harden ETL/ELT pipelines and job orchestration.
• Implement infrastructure-as-code practices for Databricks.

Skills

Azure Databricks

Automation

CI/CD

Python

SQL

Education

5+ years experience in cloud/platform engineering

2+ years hands-on experience with Databricks

Tools

Azure

Terraform

GitHub

Job description

AVEVA is creating software trusted by over 90% of leading industrial companies.

Job Title: Cloud Engineer, Data Platforms

Location: Madrid

Employment Type: Full Time (Hybrid role)

We are looking for a hands‑on Cloud Engineer with strong expertise in Azure Databricks to accelerate the delivery and operational reliability of AVEVA’s data and AI workloads. This role is based in Madrid and is expected to work collaboratively with the local Data Science and AI team as part of normal hybrid working.

The successful candidate will begin with a short induction period within the Cloud Operations team, followed by an embed period, working directly with the Data Science & AI team. During this phase, day‑to‑day priorities will be guided by the Data Science and AI team with a focus on establishing reliable, production‑grade data pipelines, hardening platform operations, and ensuring alignment to Cloud Ops standards for security, reliability, and cost efficiency. The role will provide direct support for AI for ALL delivery priorities. After this embed period, the role will transition into the standard Cloud Operations operating model.

This role is ideal for a pragmatic engineer who thrives on making platforms dependable—improving environments, hardening pipelines, automating deployments, and resolving operational issues quickly. It is highly delivery‑oriented and requires close collaboration across Cloud Ops, security/governance, and analytics teams to ensure AVEVA’s data and AI capabilities run securely, efficiently, and at scale.

Key Responsibilities

• Databricks platform engineering (Azure): Build, configure, and operate Databricks workspaces, clusters, policies, and supporting Azure services.
• Production readiness: Enable a clear path to production environments, including operational processes, runbooks, incident response practices, and release readiness.
• Pipeline reliability: Support and harden ETL/ELT pipelines (e.g., Delta Lake patterns), job orchestration, and workload performance tuning.
• Automation & CI/CD: Implement infrastructure-as-code and CI/CD practices for Databricks and related Azure resources (e.g., Terraform/Bicep, Azure DevOps/GitHub).
• Security & access: Implement least-privilege access, secrets management, identity integration, auditability, and compliance‑aligned controls (in partnership with Security / Governance).
• Observability & operations: Improve logging, monitoring, and cost controls; diagnose and resolve platform/network issues affecting delivery.
• Embedded delivery support: Participate in Madrid‑based team stand‑ups and planning; manage an agreed backlog of tasks that unblock AI for ALL and analytics delivery.

Essential Requirements

• Azure & Databricks expertise: Strong hands‑on experience operating Azure Databricks in enterprise settings; able to troubleshoot workspace, networking, and performance issues.
• Engineering discipline: Comfortable with automation, CI/CD, IaC, and operational best practices.
• Data platform fundamentals: Working knowledge of Spark, Delta Lake, Python and SQL; ability to partner effectively with data engineers, AI engineers and data scientists.
• Operational mindset: Bias to reliability and delivery; able to triage issues quickly and communicate clearly across distributed teams.
• Stakeholder collaboration: Works effectively across time zones and teams; able to translate requirements into actionable platform work.
• 5+ years experience in cloud/platform engineering (preferably Azure).
• 2+ years hands‑on experience with Databricks (Azure Databricks strongly preferred).
• Candidates who do not meet the required years of experience may still be considered if they possess the following certifications: AZ‑900 (Azure Fundamentals) AZ‑305 (Designing Azure Infra Solutions) AZ‑104, AZ‑400 (DevOps Focused) and/or AI‑102 (AI) will be advantageous.
• Experience with networking/security patterns in Azure (VNETs, private endpoints, Key Vault, managed identities, etc.).
• Experience with IaC (Terraform, ARM/Bicep) and CI/CD for platform and data workloads.

Desired Skills

• Familiarity with AWS/GCP concepts
• Experience with Unity Catalog
• Experience supporting data governance patterns and lineage/metadata tooling
• Familiarity with GenAI workload considerations.

Benefits

• Gratuity
• Medical and accidental insurance
• Very attractive leave entitlement
• Emergency leave days
• Childcare supportMaternity, paternity and adoption leaves
• Education assistance program
• Home office set up support (for hybrid roles)
• Well‑being support

AVEVA is an Equal Opportunity Employer. We are committed to being an exemplary employer with an inclusive culture, developing a workplace environment where all our employees are treated with dignity and respect. We value diversity and the expertise that people from different backgrounds bring to our business. AVEVA provides reasonable accommodation to applicants with disabilities where appropriate. If you need reasonable accommodation for any part of the application and hiring process, please notify your recruiter.