Big Data Developer

TymblHub; Bengaluru; On-site; INR 1,250,000 - 1,830,000; Full time

Job summary

EPAM Systems in Bengaluru is seeking a Big Data Developer with 6+ years of experience in big data technologies. You will work on distributed computing, Spark, and Python to build scalable data solutions.

The role involves streaming pipelines with Spark Streaming or Storm, Kafka-based messaging, NoSQL data stores, and data ingestion from RDBMS/ERP/files. AGILE experience is preferred and collaboration with cross-functional teams is expected.

Qualifications

• 6+ years of experience in Big Data and related tech.
• Expert level understanding of distributed computing principles.
• Expert level knowledge and experience in Apache Spark.
• Hands-on programming with Python.
• Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop.
• Experience with building stream-processing systems such as Spark-Streaming or Storm.
• Experience with messaging systems like Kafka or RabbitMQ.
• Good understanding of Big Data querying tools such as Hive and Impala.
• Experience with integrating data from multiple sources (RDBMS, ERP, files).
• Good understanding of SQL queries, joins, stored procedures, relational schemas.
• Experience with NoSQL databases such as HBase, Cassandra, MongoDB.
• Knowledge of ETL techniques and frameworks.
• Performance tuning of Spark jobs.
• Experience with native Cloud data services Azure Databricks.
• Ability to lead a team efficiently.
• Experience with designing and implementing Big Data solutions.
• Practitioner of AGILE methodology.

Responsibilities

• Design and implement Big Data solutions.
• Lead a team efficiently.
• Develop streaming data pipelines with Spark Streaming or Storm.
• Work with Kafka or RabbitMQ for messaging.
• Ingest data from RDBMS/ERP/files and ensure data quality.
• Tune performance of Spark jobs.

Skills

Python

Apache Spark

Distributed computing

SQL

NoSQL

Kafka

Hadoop

Databricks

Azure

Spark Streaming

Tools

Azure Databricks

Hadoop

Hive

Impala

Sqoop

Storm

Kafka

RabbitMQ

HBase

Cassandra

MongoDB

Job description

# Big Data DeveloperEpam SystemsPosted on October 21, 2026---Experience6 - 9 yrsSalary (CTC)₹12.5L - ₹18.3LJob LocationBengaluru, IndiaVacancy1DesignationBig Data DeveloperJob TypeNot specified---## Job Description**Job description**Greetings form EPAM Systems!!Your Profile is Shortlisted for Big Data Developer, please find the JD below. Please respond to this mail as confirmation.**Job Description:**1. 6+ Years of in Big Data & Data related technology experience2. Expert level understanding of distributed computing principles3. Expert level knowledge and experience in Apache Spark4. Hands on programming with Python5. Proficiency with Hadoop v2, Map Reduce, HDFS, Sqoop6. Experience with building stream-processing systems, using technologies such as Apache Storm or Spark-Streaming7. Experience with messaging systems, such as Kafka or RabbitMQ8. Good understanding of Big Data querying tools, such as Hive, and Impala9. Experience with integration of data from multiple data sources such as RDBMS (SQL Server, Oracle), ERP, Files10. Good understanding of SQL queries, joins, stored procedures, relational schemas11. Experience with NoSQL databases, such as HBase, Cassandra, MongoDB12. Knowledge of ETL techniques and frameworks13. Performance tuning of Spark Jobs14. Experience with native Cloud data services Azure Databricks15. Ability to lead a team efficiently16. Experience with designing and implementing Big data solutions17. Practitioner of AGILE methodology**Mandatory skills:**Python, Spark, Azure, DatabricksPlease confirm If you are interested and available to attend face to face interview on Saturday(24th Oct).