Senior Hadoop Data Engineer — Spark, PySpark & Kafka

Tata Consultancy Services Limited; Charlotte (NC); Presencial; USD 100.000 - 120.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Discretionary Annual Incentive

Medical Coverage: Medical & Health, 9/

Dental & Vision

401K Plan

Parental Leaves

Certification & Training Reimbursement

Descripción de la vacante

Tata Consultancy Services Limited in Charlotte, NC seeks an Engineer to lead data platform architectures and real-time streaming initiatives. The role focuses on building scalable data pipelines while ensuring security and enterprise standards.

You will mentor junior engineers, collaborate with product teams, and apply Hadoop, PySpark, Python, and Kafka expertise to deliver high-performance solutions in an agile environment.

Formación

• Minimum 10 years of experience.
• Strong experience with Hadoop ecosystem (HDFS, Hive, Spark).
• Proficiency in PySpark for distributed data processing.
• Hands-on experience with Apache Kafka for real-time streaming.

Responsabilidades

• Define end-to-end architecture for data platforms and streaming systems.
• Design and implement data ingestion, transformation, and processing pipelines.
• Mentor junior developers and data engineers; lead agile ceremonies and design discussions.

Conocimientos

Hadoop ecosystem

PySpark

Python

Apache Kafka

Educación

Bachelor of Computer Science

Herramientas

Docker

Kubernetes

AWS

Azure

GCP

Descripción del empleo

Tata Consultancy Services Limited in Charlotte, NC seeks an Engineer to lead data platform architectures and real-time streaming initiatives. The role focuses on building scalable data pipelines while ensuring security and enterprise standards.

You will mentor junior engineers, collaborate with product teams, and apply Hadoop, PySpark, Python, and Kafka expertise to deliver high-performance solutions in an agile environment.