Big Data Engineer

V2 Solutions; Hyderabad; On-site; INR 1,590,000 - 2,200,000; Full time

Job summary

Epam Systems in Hyderabad is seeking a Big Data Engineer with 6-15 years of hands-on experience in distributed data systems. The role requires strong Spark, Python, Hadoop, and SQL skills, plus experience with streaming and messaging systems.

The ideal candidate will lead a data engineering team, design scalable pipelines, optimize Spark jobs, and collaborate with cross-functional teams to deliver robust data solutions in a fast-paced environment.

Qualifications

• 6-15 years of Big Data & data-related technology experience.
• Expert level understanding of distributed computing principles.
• Hands-on programming with Python and Spark.
• Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop.
• Experience with stream processing (Spark-Streaming or Storm).
• Experience with messaging systems (Kafka, RabbitMQ).
• Strong SQL skills, data integration from multiple sources (RDBMS, ERP).
• NoSQL knowledge (HBase, Cassandra, MongoDB).
• Knowledge of ETL techniques and Spark performance tuning.

Responsibilities

• Lead a Big Data engineering team and deliver scalable data solutions.
• Design and implement big data architectures and pipelines.
• Optimize Spark jobs for performance and cost.
• Collaborate with cross-functional teams to integrate data sources.

Skills

Apache Spark

Python

Hadoop

SQL

Kafka

NoSQL

AGILE

Job description

# Big Data EngineerEpam SystemsPosted on August 25, 2026---Experience6 - 11 yrsSalary (CTC)₹15.9L - ₹22LJob LocationHyderabad, IndiaVacancy1DesignationBig Data EngineerJob TypeNot specified---## Job Description**Job Description:**6-15 Years of in Big Data & Data related technology experienceExpert level understanding of distributed computing principlesExpert level knowledge and experience in Apache SparkHands on programming with PythonProficiency with Hadoop v2, Map Reduce, HDFS, SqoopExperience with building stream-processing systems, using technologies such as Apache Storm or Spark-StreamingExperience with messaging systems, such as Kafka or RabbitMQGood understanding of Big Data querying tools, such as Hive, and ImpalaExperience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, FilesGood understanding of SQL queries, joins, stored procedures, relational schemasExperience with NoSQL databases, such as HBase, Cassandra, MongoDBKnowledge of ETL techniques and frameworksPerformance tuning of Spark JobsExperience with native Cloud data services databricks, GCPAbility to lead a team efficientlyExperience with designing and implementing Big data solutionsPractitioner of AGILE methodology