Big Data Engineer

V2 Solutions; Chennai District; On-site; INR 900,000 - 1,300,000; Full time

Job summary

YantranIN PVT LTD in Chennai, India is seeking a Big Data Engineer to design and develop distributed data-processing platforms capable of handling large-scale datasets. You will build batch and streaming pipelines, process high-volume structured and unstructured data, and implement Spark/PySpark applications.

The role includes implementing Kafka-based streaming solutions, optimizing large-scale data processing, and building data lakes and analytics platforms while ensuring data quality and

Qualifications

• Experience with large-scale distributed data processing.
• Experience building batch and streaming pipelines.
• Proficiency in Spark/PySpark and Kafka.
• Strong SQL skills and data modeling.
• Familiarity with cloud-based big data environments.

Responsibilities

• Design and develop distributed data-processing platforms.
• Build batch and streaming data pipelines.
• Process high-volume structured and unstructured data.
• Develop Spark/PySpark applications.
• Implement Kafka-based streaming solutions.
• Optimize large-scale data processing.
• Build data lakes and analytics platforms.
• Implement data quality and monitoring.
• Support cloud-based big-data environments.

Skills

Big Data

Apache Spark

PySpark

Hadoop ecosystem

Kafka

Python/Java/Scala

SQL

Databricks

Cloud (AWS/Azure/GCP)

Data Lake technologies

Job description

# Big Data EngineerYantranIN PVT LTDPosted on September 16, 2026---Experience3 - 6 yrsJob LocationChennai, IndiaVacancy1DesignationBig Data EngineerJob TypeNot specified---## Job DescriptionSeeking a Big Data Engineer to design and develop distributed data-processing platforms capable of handling large-scale datasets.**Responsibilities:*** Develop distributed data-processing applications.* Build batch and streaming pipelines.* Process high-volume structured and unstructured data.* Develop Spark/PySpark applications.* Implement Kafka-based streaming solutions.* Optimize large-scale data processing.* Build data lakes and analytics platforms.* Implement data quality and monitoring.* Support cloud-based big-data environments.**Required Skills:*** Big Data.* Apache Spark.* PySpark.* Hadoop ecosystem.* Kafka.* Python/Java/Scala.* SQL.* Databricks preferred.* AWS/Azure/GCP.* Data Lake technologies.