BigData Developer (with Scala & Spark) - Immediate Joiners

Grid Dynamics; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

A leading technology firm is seeking a Senior Big Data Developer to design and implement scalable data pipelines in Bangalore or Hyderabad. Ideal candidates should have 6-10 years of experience, proficiency in Apache Spark, and a strong background in the Hadoop ecosystem. This full-time role offers the opportunity to work with cutting-edge technologies and collaborate with cross-functional teams.

Qualifications

• 6 to 10 years of experience in software development with a strong focus on data-centric applications.
• 4+ years of hands-on experience with Hadoop ecosystem components.
• Proficiency in automating job execution and validation processes.

Responsibilities

• Design, develop, and optimize big data pipelines using Spark and Scala.
• Leverage Core Java and Go to build robust data processing applications.
• Implement automation for data ingestion and job execution.

Skills

Apache Spark

Scala

Hive

Core Java

Go

Hadoop ecosystem security

CI/CD processes

Version control (e.g., Git)

Bug tracking tools (e.g., JIRA)

Education

Bachelor's or Master's degree in Computer Science, Electrical Engineering, or Information Systems

Job description

Overview

We are seeking a highly skilled and experienced Senior Big Data Developer to join our team in Bangalore / Hyderabad / Chennai. The ideal candidate will have a strong background in software development with a focus on large-scale, data-centric applications. You will work with cutting-edge technologies in the Hadoop ecosystem, including Spark, Scala, Hive, and Go, and be responsible for designing and implementing scalable data pipelines in both real-time and batch processing environments.

Key Responsibilities

• Design, develop, and optimize big data pipelines using Spark, Scala, and Hive


• Leverage Core Java and Go to build robust data processing applications


• Work with large-scale datasets in real-time and batch mode


• Implement automation for data ingestion, job execution, and validation


• Collaborate with cross-functional teams to understand data requirements and deliver scalable solutions


• Ensure adherence to data security protocols within the Hadoop ecosystem


• Apply best practices in CI/CD, version control, and issue tracking


• Contribute to the design and architecture of data platforms


• Document technical solutions and processes clearly and concisely

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Electrical Engineering, Information Systems, or a related technical discipline (Advanced degree preferred)


• 6 to 10 years of experience in software development with a strong focus on data-centric applications


• At least 4+ years of hands-on experience working with Hadoop ecosystem, Apache Spark, Scala, Hive, Core Java, Go programming language


• Strong knowledge of Hadoop ecosystem security


• Solid understanding of database concepts and data modeling


• Experience in automating job execution and validation processes


• Proficiency in CI/CD processes, version control (e.g., Git), and bug tracking tools (e.g., JIRA)


• Expertise in Object-Oriented Programming and best practice software development methodologies

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• IT Services and IT Consulting