Senior Software Engineer (Data)

Vistance Networks, Inc.; Singapore; On-site; SGD 80,000 - 110,000; Full time

Job summary

A tech company in Singapore is seeking a Senior Software Engineer to develop big data applications in Analytics and AI. This role involves designing data processing pipelines, migrating to event-driven orchestration frameworks, and deploying workloads on Google Kubernetes Engine. Candidates should have over 5 years of experience in distributed systems, and strong skills in Scala, Apache Spark, and Kubernetes. This position offers an exciting opportunity to work with cutting-edge technology in a dynamic team environment.

Qualifications

• 5+ years of software engineering experience focusing on distributed systems, big data, or backend engineering.
• Experience in Scala (or any JVM language with a willingness to learn Scala).
• Solid understanding of Apache Kafka and Google Protobuf.
• Hands-on experience deploying applications on Kubernetes.

Responsibilities

• Design, build, and optimize complex streaming and batch pipelines.
• Lead the migration to modern, event-driven orchestration frameworks.
• Work extensively with Apache Kafka for data ingestion.
• Implement and optimize data storage using Delta Lake.
• Deploy and scale workloads on Google Kubernetes Engine.

Skills

Scala

Apache Spark

Apache Kafka

Kubernetes

Python

Helm

Event-driven orchestration

Tools

Google Kubernetes Engine (GKE)

Delta Lake

Apache Iceberg

Job description

Senior Software Engineer (Data)

Location: Singapore, Singapore, Singapore

In our 'always on' world, we believe it's essential to have a genuine connection with the work you do.

We are looking for a Senior Software Engineer to join our growing team in Singapore. You will work with a dynamic and focused team to develop state-of-the-art big data applications in Analytics and Artificial Intelligence (AI). As our Senior Software Engineer, you will be implementing our core software components, and be involved in scalable design for cloud software architecture. This is an exciting opportunity to join our talented team and be involved in the next technology trend: Analytics & AI in Networking.

Key Responsibilities

• Distributed Data Processing: Design, build, and optimize complex streaming and batch pipelines using Scala/Java/Python and Apache Spark (Structured Streaming and RDDs).
• Event-Driven Orchestration: Lead the migration of our cron-based Spark pipelines to modern, event-driven orchestration frameworks (e.g., Argo Workflows/Events, Apache Airflow, or Temporal) running on Kubernetes.
• Streaming Infrastructure: Work extensively with Apache Kafka and Google Protocol Buffers (GPB) to manage high-frequency data ingestion and schema evolution.
• Lakehouse Architecture: Implement and optimize data storage using modern open table formats like Delta Lake and Apache Iceberg (including partitioning strategies and compaction).
• Cloud-Native Deployment: Deploy, scale, and tune workloads on Google Kubernetes Engine (GKE) using Helm and the Spark K8s Operator.

Required Qualifications for Consideration

• Experience: 5+ years of software engineering experience focusing on distributed systems, big data, or backend engineering.
• Languages: Experience in Scala (or any JVM language with a willingness to learn Scala). Python/Rust is a plus.
• Big Data Frameworks: Experience with Apache Spark (tuning, partitioning, driver/executor memory management, and streaming).
• Messaging: Solid understanding of Apache Kafka (topics, partitions, consumer groups) and serialization formats like Google Protobuf.
• Infrastructure: Hands‑on experience deploying and managing applications on Kubernetes (ideally GKE) and using Helm.
• Orchestration: Experience with modern data orchestration tools (Airflow, Argo, Dagster, Prefect, or Temporal).

You Will Excite Us If You Have

• Rust: Experience writing systems‑level or high‑performance code in Rust (or a strong desire to learn and adopt it for data tooling).
• Modern Table Formats: Production experience with Delta Lake or Apache Iceberg (understanding of transaction logs, metadata, and partition pruning).
• Next‑Gen Streaming: Familiarity with emerging streaming engines like Arroyo or Apache Flink.
• Testing at Scale: Experience building distributed load‑testing frameworks or chaos engineering tools for data pipelines.

Vistance Networks is an Equal Opportunity Employer (EEO), including people with disabilities and veterans.