Senior Data Platform Engineer - Spark/Kafka/Flink/Scala/Java

NTT DATA, Inc.; Dallas (TX); Vor Ort; USD 96.000 - 145.000; Vollzeit

Benefits dieser Stelle

Medical, dental, and vision insurance

401k with company match

Paid time off

Health Spending Account (HSA)

Life and AD&D insurance

Short and long term disability

Zusammenfassung

NTT DATA in Dallas, TX is seeking a Data Engineer - Data Platform to design, implement, and operate real-time and batch data pipelines using Spark, Flink, and Kafka. You will build cloud-native solutions on Azure, lead migrations, and collaborate with cross-functional teams to deliver scalable data platforms.

The role requires strong distributed systems experience, platform engineering focus, and a commitment to automation, CI/CD, and data modernization.

Qualifikationen

• 8+ years in Software or Data Engineering.
• 5+ years with Spark for batch/streaming.
• 5+ years with Kafka for real-time streaming.
• 3+ years with Flink for streaming analytics.
• 5+ years with Java and/or Scala.
• 5+ years writing complex SQL and optimizing databases.
• 3+ years with Kubernetes/container deployment.
• 3+ years on Microsoft Azure.
• 3+ years with Cassandra/YugabyteDB/PostgreSQL or similar.
• 3+ years building event-driven architectures.
• 2+ years CI/CD with GitLab/GitHub or similar tools.
• 2+ years cloud-native deployment patterns.

Aufgaben

• Design, develop, and support scalable real-time and batch data pipelines using Apache Spark, Apache Flink, Apache Kafka, and Airflow.
• Build and enhance metadata-driven self-service data integration platforms and reusable connectors.
• Develop and maintain source and target connectors for relational databases, file systems, Kafka, Cassandra, YugabyteDB, and other enterprise data stores.
• Design, deploy, and operate Kubernetes-based streaming and batch processing platforms.
• Lead cloud migration initiatives from on-premise environments to Microsoft Azure.
• Drive performance tuning, scalability optimization, reliability improvements, and operational excellence across large-scale data workloads.
• Develop cloud-native solutions supporting enterprise data movement and processing.
• Collaborate with product owners, architects, cloud engineering teams, and business stakeholders to deliver enterprise-scale data solutions.
• Contribute to platform modernization, automation, CI/CD implementation, and engineering best practices.
• Support troubleshooting, production stability, and continuous improvement initiatives for critical data platforms.

Kenntnisse

Spark

Kafka

Flink

Scala

Java

SQL

CI/CD

Ausbildung

Bachelor's degree in Computer Science, Information Technology, Engineering

Tools

Kubernetes

Airflow

Azure

Jobbeschreibung

NTT DATA in Dallas, TX is seeking a Data Engineer - Data Platform to design, implement, and operate real-time and batch data pipelines using Spark, Flink, and Kafka. You will build cloud-native solutions on Azure, lead migrations, and collaborate with cross-functional teams to deliver scalable data platforms.

The role requires strong distributed systems experience, platform engineering focus, and a commitment to automation, CI/CD, and data modernization.