Software Engineer

Skyhigh Security; Bengaluru; On-site; INR 1,000,000 - 1,800,000; Full time

Job summary

Skyhigh Security is seeking a data engineering professional to design, develop, and maintain scalable data processing applications and distributed systems in a fast-paced cloud environment. You will build and optimize large-scale batch and streaming pipelines using Java/Scala, and work with Spark, Hadoop, Kafka, and related technologies.

Your role includes contributing to system design (HLD/LLD), implementing TDD, CI/CD, and automated tests, and collaborating with data engineers, architects,

Qualifications

• 3–5 years of experience in software development with a focus on big data platforms and analytics systems.
• Strong foundation in data structures & algorithms, OS, DBMS, networks, and OOP.
• Proven ability to build scalable, reliable distributed applications in Agile environments.
• Experience with Spark, Hadoop, Kafka, and data pipelines.
• Proficient in Java and Scala with concurrency awareness.
• Familiarity with AWS and containerized platforms (Kubernetes, EKS).
• Experience with CI/CD, GitHub, SVN, and testing practices.

Responsibilities

• Design, develop, test, and maintain scalable data processing applications and distributed systems.
• Build and optimize large-scale batch and streaming data pipelines.
• Develop high-performance solutions using Java and/or Scala for data-intensive workloads.
• Work with big data ecosystems to process, transform, and analyze large datasets.
• Participate in system design discussions and contribute to HLD and LLD activities.
• Implement software engineering best practices including TDD, code reviews, CI/CD, and automated testing.
• Troubleshoot production issues and drive performance optimization initiatives.
• Collaborate with data engineers, architects, product managers, and business stakeholders to deliver data-driven solutions.
• Ensure reliability, scalability, security, and maintainability of data platforms and applications.
• Contribute to technical documentation, architecture reviews, and knowledge-sharing initiatives.

Skills

Java

Scala

Big data platforms

Algorithms

Data structures

OS

Networking

OOP

Agile

Problem solving

Education

BE/B.Tech in CS/IT

Tools

Apache Spark

Hadoop

MapReduce

Apache HBase

Apache Kafka

Apache Oozie

Hue

AWS

Amazon EMR

Amazon EKS

Kubernetes

CI/CD

GitHub

SVN

Job description

Skyhigh Security is a dynamic, fast-paced, cloud company that is a leader in the security industry. Our mission is to protect the world’s data, and because of this, we live and breathe security. We value learning at our core, underpinned by openness and transparency.

Since 2011, organizations have trusted us to provide them with a complete, market-leading security platform built on a modern cloud stack. Our industry-leading suite of products radically simplifies data security through easy-to-use, cloud-based, Zero Trust solutions that are managed in a single dashboard, powered by hundreds of employees across the world. With offices in Santa Clara, Aylesbury, Paderborn, Bengaluru, Sydney, Tokyo and more, our employees are the heart and soul of our company.

Key Responsibilities

• Design, develop, test, and maintain scalable data processing applications and distributed systems.
• Build and optimize large-scale batch and streaming data pipelines.
• Develop high-performance solutions using Java and/or Scala for data-intensive workloads.
• Work with big data ecosystems to process, transform, and analyze large datasets efficiently.
• Participate in system design discussions and contribute to High-Level Design (HLD) and Low-Level Design (LLD) activities.
• Implement software engineering best practices including Test-Driven Development (TDD), code reviews, CI/CD, and automated testing.
• Troubleshoot production issues and drive performance optimization initiatives.
• Collaborate with data engineers, architects, product managers, and business stakeholders to deliver data-driven solutions.
• Ensure reliability, scalability, security, and maintainability of data platforms and applications.
• Contribute to technical documentation, architecture reviews, and knowledge-sharing initiatives.

About You :

• Professional Experience: 3–5 years of experience in software development with a focus on big data platforms and analytics systems
• Foundational Knowledge: Strong academic background in Data Structures & Algorithms, Operating Systems, Database Management Systems, Computer Networks, and Object-Oriented Programming.
• Core Competencies: Ability to build scalable and reliable distributed applications, strong problem-solving and analytical skills, experience in Agile environments, excellent communication and stakeholder collaboration, and a proven ability to learn new technologies quickly.
• Big Data & Analytics: Apache Spark, Hadoop, MapReduce, Apache HBase, data pipeline development, and large-scale data processing.
• Programming: Expert-level proficiency in Java and Scala; strong foundation in data structures, algorithms, and concurrency.
• Cloud & Platform: Experience with AWS, Amazon EMR, Amazon EKS, and Kubernetes.
• Data Streaming & Orchestration: Proficient with Apache Kafka, Apache Oozie, and Hue.
• DevOps & Tools: CI/CD pipeline implementation, GitHub, and SVN.
• Architecture & Engineering: Expertise in HLD/LLD, Microservices design patterns, and TDD practices.
• Education: Bachelor's degree (BE/B.Tech) in Computer Science, IT, or Software Engineering from a reputed university.