Lead I - DevOps Engineering

UST

Chennai District

On-site

INR 4,000,000 - 6,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

UST is seeking an experienced Senior Data Platform Engineer to join our Chennai-area team. You will own and operate data platform infrastructure across Databricks, Unity Catalog, and Airflow, while building reusable Terraform modules and scalable CI/CD pipelines.

You will collaborate on dbt environments, Fivetran workflows, and security practices with Okta/ServiceNow integration. The role requires strong Python engineering, production-grade automation, cost management, and expertise in IaC.

Qualifications

  • 8+ years in data platform engineering or related fields.
  • 5+ years hands-on Terraform and IaC experience including modules, state management, imports, plans, provider and version control.
  • Strong Python for APIs, automation, testing, packaging, logging, error handling.
  • Production experience with Databricks and Unity Catalog.
  • Strong Production Apache Airflow experience.
  • Experience operating dbt environments, jobs and CI/CD workflows.

Responsibilities

  • Provision and manage platform resources through reusable Terraform modules and IaC.
  • Operate Databricks accounts and workspaces including identities, groups, entitlements and compute policies.
  • Configure Unity Catalog metastores, catalogs, schemas, and storage credentials.
  • Operate dbt projects, environments, connections, jobs and CI quality gates.
  • Engineer Astro/Airflow capabilities covering DAG standards and safe recovery.
  • Integrate Fivetran, dbt, Databricks and Atlan via APIs and webhooks.
  • Establish platform SLOs; monitor reliability, data quality and cost.

Skills

Data platform engineering
DataOps
Platform Engineering
DevOps
SRE
Python engineering
API automation
Cost management

Tools

Terraform
IaC
Databricks
Unity Catalog
Airflow
dbt
Fivetran
Atlan
Okta/ServiceNow
CI/CD

Job description

Role Description
  • 8+ years in data platform engineering (DataBricks), DataOps, platform engineering, DevOps or SRE.
  • At least 5+ years of hands‑on Terraform and IaC experience, including modules, state management, imports, plans, provider and version control, environment separation, drift detection and CI/CD.
  • Strong Python engineering for APIs, automation, testing, packaging, structured logging, error handling and reusable tooling.
  • Production experience operating Databricks and Unity Catalog.
  • Strong production Apache Airflow experience.
  • Experience operating dbt environments, jobs and CI/CD workflows.
  • AWS IAM, S3, VPC/private connectivity, KMS, Secrets Manager and CloudWatch.
  • Git, CI/CD, REST APIs, SQL, Linux, OAuth, SAML/SCIM and service‑principal authentication.
  • Experience with monitoring, incident response, change control, rollback and cost management.
  • Relevant Databricks platform training or certification is highly preferred. Responsibilities
  • Provision and manage platform resources through reusable Terraform modules and configuration as code.
  • Operate Databricks accounts and workspaces, including identities, groups, service principals, entitlements, compute policies, clusters, SQL warehouses and Jobs/Workflows.
  • Configure Unity Catalog metastores, catalogs, schemas, external locations, storage credentials, workspace bindings, ownership and least‑privilege access.
  • Operate dbt projects, environments, connections, jobs, permissions, service tokens, CI quality gates and promotion controls.
  • Engineer production Astro/Airflow capabilities covering DAG standards, dependencies, retries, timeouts, concurrency, backfills, ing and safe recovery.
  • Orchestrate and integrate Fivetran, dbt, Databricks and Atlan using APIs, webhooks and workload identities.
  • Implement Fivetran usage monitoring, cost thresholds, non‑production lifecycle guardrails and configuration portability.
  • Enable governed Atlan and Tableau connectivity, metadata, lineage, access and operational workflows.
  • Implement ADLC controls for branching, testing, approval, environment promotion, deployment evidence and rollback.
  • Integrate identity and access workflows with Okta or equivalent identity providers and ServiceNow.
  • Establish platform and pipeline SLOs; monitor reliability, schema changes, data quality, usage and cost.
  • Troubleshoot incidents, perform root‑cause analysis and automate recurrence prevention.
  • Maintain runbooks, configuration inventories, access evidence and recovery procedures
Role Description
  • 8+ years in data platform engineering (DataBricks), DataOps, platform engineering, DevOps or SRE.
  • At least 5+ years of hands‑on Terraform and IaC experience, including modules, state management, imports, plans, provider and version control, environment separation, drift detection and CI/CD.
  • Strong Python engineering for APIs, automation, testing, packaging, structured logging, error handling and reusable tooling.
  • Production experience operating Databricks and Unity Catalog.
  • Strong production Apache Airflow experience.
  • Experience operating dbt environments, jobs and CI/CD workflows.
  • AWS IAM, S3, VPC/private connectivity, KMS, Secrets Manager and CloudWatch.
  • Git, CI/CD, REST APIs, SQL, Linux, OAuth, SAML/SCIM and service‑principal authentication.
  • Experience with monitoring, incident response, change control, rollback and cost management.
  • Relevant Databricks platform training or certification is highly preferred. Responsibilities
  • Provision and manage platform resources through reusable Terraform modules and configuration as code.
  • Operate Databricks accounts and workspaces, including identities, groups, service principals, entitlements, compute policies, clusters, SQL warehouses and Jobs/Workflows.
  • Configure Unity Catalog metastores, catalogs, schemas, external locations, storage credentials, workspace bindings, ownership and least‑privilege access.
  • Operate dbt projects, environments, connections, jobs, permissions, service tokens, CI quality gates and promotion controls.
  • Engineer production Astro/Airflow capabilities covering DAG standards, dependencies, retries, timeouts, concurrency, backfills, ing and safe recovery.
  • Orchestrate and integrate Fivetran, dbt, Databricks and Atlan using APIs, webhooks and workload identities.
  • Implement Fivetran usage monitoring, cost thresholds, non‑production lifecycle guardrails and configuration portability.
  • Enable governed Atlan and Tableau connectivity, metadata, lineage, access and operational workflows.
  • Implement ADLC controls for branching, testing, approval, environment promotion, deployment evidence and rollback.
  • Integrate identity and access workflows with Okta or equivalent identity providers and ServiceNow.
  • Establish platform and pipeline SLOs; monitor reliability, schema changes, data quality, usage and cost.
  • Troubleshoot incidents, perform root‑cause analysis and automate recurrence prevention.
  • Maintain runbooks, configuration inventories, access evidence and recovery procedures
Skills

Databricks, DataOps, Platform Engineering, DevOps, CI/CD, AWS IAM, Amazon S3, OAuth 2.0, SQL, Linux, SAML

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Platform Engineer
Databricks Platform Engineer

Zorba Consulting India • Mumbai

On-site
INR 2,500,000 - 4,200,000
AWS DevOps for Data Platforms
AWS DevOps for Data Platforms

NTT DATA, Inc. • Hyderabad

On-site
INR 3,500,000 - 6,000,000
Tech Lead – Databricks / Data Platform
Tech Lead – Databricks / Data Platform

Palo Alto Labs • Pune District

Remote
INR 4,500,000 - 7,500,000
Tech Lead – Databricks / Data Platform
Tech Lead – Databricks / Data Platform

Palo Alto Innovation Labs • Pune District

Remote
INR 4,000,000 - 6,500,000
Databricks & Snowflake Infrastructure Engineer
Databricks & Snowflake Infrastructure Engineer

NTT DATA, Inc. • Hyderabad

On-site
INR 4,000,000 - 7,000,000
Cloud Engineer
Cloud Engineer

Birlasoft • Dadri, Pune District, Bengaluru

Hybrid
INR 2,400,000 - 4,200,000
Data Engineer, Data Platforms
Data Engineer, Data Platforms

S&P Global • Hyderabad

On-site
INR 1,500,000 - 2,100,000
Senior AI Engineer Manager
Senior AI Engineer Manager

Ecolab, Inc. • Bengaluru

Hybrid
INR 4,000,000 - 7,000,000
Assistant Director-Databricks Platform and Data Engineer
Assistant Director-Databricks Platform and Data Engineer

Acuity Knowledge Partners • Bengaluru

On-site
INR 1,800,000 - 2,400,000
Databricks Platform Administrator (AWS)
Databricks Platform Administrator (AWS)

Abjayon • India

Remote
INR 350,000 - 550,000