Platform Engineer

EXL; New York (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

EXL is seeking a Platform Engineer to design, implement, automate and operate cloud infrastructure for large-scale analytics workloads on AWS.

You will build and manage Databricks workspaces, apply IaC with Terraform and AWS CDK, and drive CI/CD pipelines using GitHub Actions, CodeBuild, CodeDeploy, and ArgoCD. The role emphasizes platform reliability, governance, and cost optimization.

Qualifications

• Strong hands‑on experience managing AWS infrastructure (EC2, EKS, Lambda, VPCs, IAM).
• Experience with Databricks on AWS including workspace/admin tasks and compute management.
• Proficient in Terraform and IaC for provisioning and scaling cloud resources.
• Practical CI/CD implementation using GitHub Actions, CodeBuild, CodeDeploy.
• Familiarity with ArgoCD for GitOps based deployments.
• Knowledge of data engineering pipelines, ETL/ELT, and workload orchestration.
• Solid understanding of cloud security, governance, and Well-Architected principles.
• Ability to design scalable, reliable, and cost-efficient platform solutions.

Responsibilities

• Design, build, and manage scalable AWS infrastructure for analytics workloads.
• Automate provisioning and environment management with IaC (Terraform / AWS CDK).
• Set up DevOps pipelines with GitHub, Actions, CodeBuild, CodeDeploy, and ArgoCD.
• Design, deploy, and manage Databricks workspaces, clusters, policies, and Unity Catalog.
• Collaborate with data engineering teams to enable reliable pipelines and orchestration.
• Automate deployment and lifecycle management of data platform components and jobs.
• Support infra components like Glue, DynamoDB, and Redshift.
• Monitor platform performance, reliability, and cloud costs; troubleshoot issues.
• Apply Well-Architected security, governance, and operational best practices.
• Develop reusable templates and SOPs across engagements.

Skills

AWS infrastructure

Databricks on AWS

Terraform

CI/CD pipelines

GitHub Actions

ArgoCD

DevOps practices

Security & governance

Tools

Terraform

AWS CDK

GitHub Actions

CodeBuild

CodeDeploy

ArgoCD

Databricks on AWS

Unity Catalog

Job description

EXL is seeking an experienced Platform Engineer to design, implement, automate and operate cloud infrastructure for large scale analytics and data engineering workloads. This role focuses on building and managing Databricks on AWS, Infrastructure-as-Code, CI/CD automation, platform reliability, and cloud governance. The ideal candidate will bring strong hands‑on experience across AWS cloud services, Terraform, DevOps practices, and a solid understanding of data engineering platforms, pipelines, and workload orchestration.

Responsibilities:

• Design, build, and manage scalable AWS infrastructure including EC2, EKS, Lambda, API Gateway, VPCs, IAM, Security Groups, Load Balancers, and routing components
• Implement Infrastructure-as-Code (IaC) using Terraform/AWS CDK to automate provisioning, scaling, and environment management
• Set up and manage DevOps pipelines using GitHub, GitHub Actions, CodeBuild, CodeDeploy and ArgoCD to support automated build, test, and deployment workflows.
• Design, deploy, and manage Databricks workspaces, clusters, cluster policies, Unity Catalog, networking, and security integrations on AWS.
• Partner with data engineering teams to enable reliable execution of pipelines, data ingestion frameworks, batch processing, and workflow orchestration.
• Automate deployment and lifecycle management of data platform components, including Databricks jobs, workflows, libraries, secrets, service principals, and environment configurations.
• Collaborate with data engineering teams to support infrastructure components such as AWS Glue, Lambda, Databricks on AWS, DynamoDB, and Redshift.
• Monitor and optimize platform performance, reliability, and cloud costs for data engineering workloads and analytics platforms. Troubleshoot platform, connectivity, and workload issues
• Utilize AWS Well-Architected Framework principles to design secure, reliable, cost-efficient, and high-performing solutions
• Implement platform governance, access controls, security standards, and operational best practices across cloud and data platforms.
• Contribute to establishing DevOps best practices, reusable templates, and standard operating procedures across engagements

Qualifications:

• Strong hands‑on experience managing AWS infrastructure through Terraform, including networking, security, compute, storage, and IAM services.
• Practical experience working with Databricks on AWS, including workspace administration, compute management, job orchestration, and platform operations.
• Good understanding of data engineering concepts such as ETL/ELT pipelines, data lakes, workflow orchestration, batch processing, and data platform architecture.
• Working knowledge of data engineering ecosystems and tools (e.g., Databricks, AWS Glue, Redshift).
• Practical experience designing and maintaining CI/CD pipelines.
• Solid understanding of cloud architecture patterns, DevOps workflows, automation, and monitoring practices.