Platform Engineer: Cloud Data Infra & Databricks on AWS

EXL; New York (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

EXL is seeking a Platform Engineer to design, implement, automate and operate cloud infrastructure for large-scale analytics workloads on AWS.

You will build and manage Databricks workspaces, apply IaC with Terraform and AWS CDK, and drive CI/CD pipelines using GitHub Actions, CodeBuild, CodeDeploy, and ArgoCD. The role emphasizes platform reliability, governance, and cost optimization.

Qualifications

• Strong hands‑on experience managing AWS infrastructure (EC2, EKS, Lambda, VPCs, IAM).
• Experience with Databricks on AWS including workspace/admin tasks and compute management.
• Proficient in Terraform and IaC for provisioning and scaling cloud resources.
• Practical CI/CD implementation using GitHub Actions, CodeBuild, CodeDeploy.
• Familiarity with ArgoCD for GitOps based deployments.
• Knowledge of data engineering pipelines, ETL/ELT, and workload orchestration.
• Solid understanding of cloud security, governance, and Well-Architected principles.
• Ability to design scalable, reliable, and cost-efficient platform solutions.

Responsibilities

• Design, build, and manage scalable AWS infrastructure for analytics workloads.
• Automate provisioning and environment management with IaC (Terraform / AWS CDK).
• Set up DevOps pipelines with GitHub, Actions, CodeBuild, CodeDeploy, and ArgoCD.
• Design, deploy, and manage Databricks workspaces, clusters, policies, and Unity Catalog.
• Collaborate with data engineering teams to enable reliable pipelines and orchestration.
• Automate deployment and lifecycle management of data platform components and jobs.
• Support infra components like Glue, DynamoDB, and Redshift.
• Monitor platform performance, reliability, and cloud costs; troubleshoot issues.
• Apply Well-Architected security, governance, and operational best practices.
• Develop reusable templates and SOPs across engagements.

Skills

AWS infrastructure

Databricks on AWS

Terraform

CI/CD pipelines

GitHub Actions

ArgoCD

DevOps practices

Security & governance

Tools

Terraform

AWS CDK

GitHub Actions

CodeBuild

CodeDeploy

ArgoCD

Databricks on AWS

Unity Catalog

Job description

EXL is seeking a Platform Engineer to design, implement, automate and operate cloud infrastructure for large-scale analytics workloads on AWS.

You will build and manage Databricks workspaces, apply IaC with Terraform and AWS CDK, and drive CI/CD pipelines using GitHub Actions, CodeBuild, CodeDeploy, and ArgoCD. The role emphasizes platform reliability, governance, and cost optimization.