Senior Data Platform Engineer — Real-Time Pipelines

NTT DATA, Inc.; Dallas (TX); On-site; USD 96,000 - 145,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

HSA/FSA

Life insurance

Disability coverage

PTO

Employee assistance

401k with match

Job summary

NTT DATA is seeking a Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) for a Dallas, TX team on an onsite-hybrid model. The role focuses on building next-gen, cloud-native data platforms powering real-time and batch data movement at enterprise scale.

You will design streaming and batch frameworks, develop Spark/Flink/Kafka processing engines, and lead cloud migrations to Azure with Kubernetes. Strong distributed-systems background and CI/CD practice are essential.

Qualifications

• 8+ years of software/data engineering experience.
• 5+ years with Apache Spark for batch and streaming processing.
• 5+ years with Apache Kafka for real-time data streaming.
• 3+ years with Apache Flink for stream processing.
• 5+ years with Java and/or Scala.
• 5+ years writing complex SQL queries and optimizing DB performance.
• 3+ years with Kubernetes and containerized deployment.
• 3+ years building on Microsoft Azure Cloud.
• 3+ years building distributed data platforms with Cassandra, YugabyteDB, PostgreSQL, or similar databases.
• 3+ years building event-driven architectures and streaming apps.
• 2+ years implementing CI/CD pipelines and deployment automation.
• 2+ years cloud-native deployment patterns and platform automation.

Responsibilities

• Design, develop, and support scalable real-time and batch data pipelines using Spark, Flink, Kafka, and Airflow.
• Build and enhance metadata-driven self-service data platforms and reusable connectors.
• Develop and maintain source and target connectors for relational databases, file systems, Kafka, Cassandra, YugabyteDB, and other data stores.
• Design, deploy, and operate Kubernetes-based streaming and batch processing platforms.
• Lead cloud migration initiatives to Microsoft Azure.
• Drive performance tuning, scalability optimization, reliability improvements, and operational excellence.
• Develop cloud-native solutions supporting enterprise data movement and processing.
• Collaborate with product owners, architects, cloud engineering teams, and stakeholders to deliver enterprise-scale data solutions.
• Contribute to platform modernization, automation, CI/CD implementation, and engineering best practices.
• Support troubleshooting, production stability, and continuous improvement initiatives for critical data platforms.

Skills

Spark

Kafka

Flink

Scala

Java

SQL

Kubernetes

Azure

CI/CD

GitHub

GitLab

Distributed systems

Data pipelines

Airflow

Cloud migration

Education

Bachelor's degree

Tools

Airflow

Cassandra

YugabyteDB

PostgreSQL

Kubernetes

Job description

NTT DATA is seeking a Data Engineer - Data Platform (Spark/Kafka/Flink/Scala/Java) for a Dallas, TX team on an onsite-hybrid model. The role focuses on building next-gen, cloud-native data platforms powering real-time and batch data movement at enterprise scale.

You will design streaming and batch frameworks, develop Spark/Flink/Kafka processing engines, and lead cloud migrations to Azure with Kubernetes. Strong distributed-systems background and CI/CD practice are essential.