Data Platform Engineer

EXL; Scottsdale (AZ); Hybrid; USD 150,000 - 200,000; Full time

Job summary

EXL in Scottsdale, Arizona is seeking a Data Platform Engineer to design, deploy, automate, and support enterprise data platform infrastructure built on Cloudera Data Platform (CDP).

You will collaborate with infrastructure, security, DevOps, and data engineering teams to ensure a secure, highly available, scalable platform that supports critical financial data processing and analytics workloads. This is a hybrid role with 2 days onsite and 3 days remote.

Qualifications

• Strong experience in SQL and data modeling.
• Experience with workflow orchestration tools like Airflow.
• Familiarity with cloud platforms (AWS/Azure/GCP) is a plus.
• Strong problem-solving and analytical skills.
• CI/CD experience with Git, Jenkins, and automation.
• Experience with Cloudera Data Platform (CDP) and Cloudera Manager.
• Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, Oozie).
• Shell scripting (Bash) and Python.

Responsibilities

• Deploy, administer, and maintain CDP clusters across environments.
• Automate infrastructure provisioning and configuration management using Ansible.
• Monitor platform health and optimize Hadoop ecosystem services.
• Perform cluster upgrades and capacity planning.
• Implement security controls (Kerberos, LDAP/AD, TLS, RBAC).
• Collaborate with data engineering and application teams for ingestion/analytics workloads.
• Develop operational automation and CI/CD workflows.
• Maintain system documentation and SOPs.
• Ensure compliance with security, governance, and regulatory standards.
• Participate in 24x7 on-call support in rotation.

Skills

SQL

Data modeling

Airflow

Python

Shell scripting

CDP

Cloudera Manager

Ansible

Hadoop ecosystem

Kafka

Oozie

Tools

Cloudera Data Platform (CDP)

Cloudera Manager

Ansible

Jenkins

Prometheus

Grafana

Job description

Locations: Scottsdale, Arizona (Hybrid – 2 days onsite and 3 days’ work from home)

Type: Full-time

Experience: 6+ Years

Job Summary

We are seeking a data platform engineer who will be responsible for responsible for designing, deploying, automating, and supporting enterprise data platform infrastructure built on Cloudera Data Platform (CDP). The role emphasizes platform reliability, automation, and operational excellence by leveraging Ansible to provision, configure, patch, and manage large-scale Hadoop and cloud-based data environments. Working closely with infrastructure, security, DevOps, and data engineering teams, the engineer ensures the platform remains secure, highly available, scalable, and optimized to support critical financial data processing and analytics workloads.

Key Responsibilities

• Deploy, administer, and maintain Cloudera Data Platform (CDP) clusters across development, testing, and production environments.
• Automate infrastructure provisioning, software installation, configuration management, and patching using Ansible playbooks and roles.
• Monitor platform health, troubleshoot performance issues, and optimize Hadoop ecosystem services.
• Perform cluster upgrades, capacity planning, disaster recovery testing, and lifecycle management.
• Implement security controls including Kerberos, LDAP/Active Directory integration, TLS, and role-based access control.
• Collaborate with data engineering and application teams to support ingestion, processing, and analytics workloads.
• Develop operational automation and CI/CD workflows to improve platform efficiency and reduce manual effort.
• Maintain system documentation, standard operating procedures, and automation artifacts.
• Ensure platform compliance with enterprise security, governance, and regulatory standards.
• Participate in 24 hrs on-call support in rotation (secondary and primary Pager duty).

Required Skills & Qualifications

• Strong experience in SQL and data modeling
• Experience with workflow orchestration tools like Airflow
• Good understanding of ETL/ELT processes and data pipeline architecture
• Familiarity with cloud platforms (AWS/Azure/GCP) is a plus
• Strong problem-solving and analytical skills
• Ability to effectively collaborate with global stakeholders and teams
• Cloudera Data Platform (CDP) and Cloudera Manager
• Ansible automation, playbook development, and configuration management
• Hadoop ecosystem components (HDFS, YARN, Hive, Impala, Spark, Solr, Kafka, Oozie)
• Shell scripting (Bash) and Python
• Git, Jenkins, and CI/CD pipelines
• Monitoring tools such as Prometheus, Grafana, or Splunk
• Networking, DNS, load balancing, and storage concepts
• Cassandra (docker) knowledge is a plus.
• AI knowledge will be welcomed
• Experience in fintech and banking would also count.