Senior Data Operations Engineer — Hybrid Data Pipelines

NTT DATA, Inc.; Auburn Hills (MI); Híbrido; USD 110 000 - 160 000; Tempo integral

Resumo da oferta

NTT DATA seeks a Senior Data Operations Engineer in Auburn Hills, MI, to own and maintain data pipelines and infrastructure. The role emphasizes incident management, performance tuning, and end-to-end ETL/ELT operations across AWS Glue, S3, RDS, and Cloudera ecosystems.

The candidate will troubleshoot Spark jobs, manage BI tools, and collaborate with security and IT teams in a hybrid on-site environment. 8+ years of hands-on experience required.

Qualificações

• 8+ years in data operations/production support.
• Proficient in Python and Java for pipeline support and automation.
• Strong hands-on experience with AWS services (Glue, S3, RDS).
• Knowledge of GCP cloud platform.
• Deep experience with Cloudera Hadoop ecosystem (HDFS, Impala).
• 5+ years with Oracle databases and OLTP systems.
• 3+ years with Apache Spark for distributed data processing.
• Experience with ETL/ELT design and troubleshooting.
• Familiarity with BI tools (Tableau, Power BI).
• Knowledge of Tomcat server administration.
• Strong Git version control and PR workflows.
• ITIL incident/change/problem management expertise.
• Awareness of application security vulnerability practices.
• Excellent troubleshooting and communication skills.
• Ability to work in on-call rotation for production systems.

Responsabilidades

• Monitor and support batch job execution across data pipelines; resolve failures proactively.
• Participate in on-call rotation; respond to production incidents promptly.
• Own incident/change/problem management processes per ITIL.
• Monitor ticket queues and meet SLAs; manage administration of data platforms.
• Develop, troubleshoot, and optimize Python and Java code for batch operations.
• Identify performance bottlenecks; optimize code and queries.
• Support ETL/ELT pipelines end-to-end including data extraction, transformation, loading.
• Manage AWS Glue jobs, crawlers, and workflows for orchestration.
• Support data storage and DB layers (S3, RDS); perform query tuning.
• Support Oracle OLTP systems and perform troubleshooting.
• Administer Cloudera Hadoop components (HDFS, Impala).
• Work with Apache Spark for large-scale processing and tuning.
• Maintain BI tooling (Tableau, Power BI) for reporting needs.
• Ensure code reviews and gating before production releases.

Conhecimentos

Python

Java

AWS

GCP

Cloudera Hadoop

Oracle databases

Apache Spark

ETL/ELT

Tableau/Power BI

Tomcat

Git

ITIL

Security best practices

On-call support

Ferramentas

AWS Glue

S3

RDS

HDFS

Impala

Oracle OLTP

Apache Spark

Tableau

Power BI

Tomcat

Descrição da oferta de emprego

NTT DATA seeks a Senior Data Operations Engineer in Auburn Hills, MI, to own and maintain data pipelines and infrastructure. The role emphasizes incident management, performance tuning, and end-to-end ETL/ELT operations across AWS Glue, S3, RDS, and Cloudera ecosystems.

The candidate will troubleshoot Spark jobs, manage BI tools, and collaborate with security and IT teams in a hybrid on-site environment. 8+ years of hands-on experience required.