Big Data Developer

Sky Systems, Inc. (SkySys); Hyderabad; Híbrido; INR 2.000.000 - 3.200.000; Jornada completa

Descripción de la vacante

Sky Systems, Inc. (SkySys) is seeking an experienced Big Data Engineer in Hyderabad for a full-time contract role.

The position focuses on developing and optimizing large-scale batch and API-based applications on AWS, using Scala, PySpark, and Java. Responsibilities include building REST/SOAP services, working with Spark, Hadoop, HDFS, MapReduce, and Cassandra, and supporting AWS workloads with EMR, EC2, ECS, S3, Airflow, and API Gateway.

Formación

• 6+ years of experience developing and testing big data applications.
• Strong Scala, PySpark, and Java programming skills.
• Hands-on AWS experience, particularly EMR and related batch-processing services.
• Experience with Spark, Hadoop/HDFS, MapReduce, and REST/SOAP services.
• Strong Linux and shell scripting skills.

Responsabilidades

• Develop and maintain big data batch applications and API-based services on AWS.
• Build REST and SOAP web services using Scala, PySpark, Java, or related technologies.
• Work with Apache Spark, Hadoop, HDFS, MapReduce, and Cassandra.
• Develop and support AWS workloads using EMR, EC2, ECS, S3, Airflow, Step Functions, and API Gateway.
• Tune and optimize batch processing performance across Spark, Hadoop, EMR, Java, and Python applications.
• Use Linux, shell scripting, and Python for automation, troubleshooting, and operational support.
• Collaborate with DevOps teams on version control, CI/CD, and deployment processes.

Conocimientos

Scala

PySpark

Java

Linux scripting

Big Data

Herramientas

AWS

EMR

EC2

S3

ECS

Airflow

Step Functions

API Gateway

Spark

Hadoop

HDFS

MapReduce

Cassandra

Linux

Descripción del empleo

Position Type: Full-Time Contract (40hrs/week)

Contract Duration: 6 months+

Work Schedule: 8 hours/day (Mon-Fri)

Location: Hyderabad, Hybrid(Wed and Thursday to be onsite)

We are looking for an experienced Big Data Engineer to develop, implement, test, and optimize large-scale batch and API-based applications on AWS. The ideal candidate will have strong hands‑on programming experience in Scala, PySpark, and Java, along with expertise in Spark/Hadoop processing, AWS services, and Linux scripting.

Key Responsibilities

• Develop and maintain big data batch applications and API-based services on AWS.
• Build REST and SOAP web services using Scala, PySpark, Java, or related technologies.
• Work with Apache Spark, Hadoop, HDFS, MapReduce, and Cassandra.
• Develop and support AWS workloads using EMR, EC2, ECS, S3, Airflow, Step Functions, and API Gateway.
• Tune and optimize batch processing performance across Spark, Hadoop, EMR, Java, and Python applications.
• Use Linux, shell scripting, and Python for automation, troubleshooting, and operational support.
• Collaborate with DevOps teams on version control, CI/CD, and deployment processes.

Requirements

• 6+ years of experience developing and testing big data applications.
• Strong Scala, PySpark, and Java programming skills.
• Hands‑on AWS experience, particularly EMR and related batch‑processing services.
• Experience with Spark, Hadoop/HDFS, MapReduce, and REST/SOAP services.
• Strong Linux and shell scripting skills.

Location: Hyderabad, hybrid — onsite Wednesday and Thursday.