Staff Software Engineer

Platform&Co; Singapore; On-site; SGD 140,000 - 210,000; Full time

Job summary

Platform&Co is hiring a senior data platform engineer to design and deliver large-scale data pipelines on a cloud-native platform. You will establish reusable patterns for low-latency analysis and build REST/gRPC APIs and AI-driven interfaces for efficient data interaction.

You will own reliability, scalability, and cost efficiency, tackling millions of concurrent workloads and working with distributed teams to translate complex requirements into scalable product architectures.

Qualifications

• Requires degree in computer science/engineering or related field.
• Proven experience delivering large-scale data-intensive production software in the cloud (AWS/Azure/GCP).
• Strong hands-on with Docker, Kubernetes, infra automation, and CI/CD.
• Deep knowledge of data lakehouse architectures and catalog/snapshot management.
• Experience with columnar formats (Parquet) and engines (Spark/Trino/Databricks).
• Proficiency in Python for prototyping, data processing, and tooling.
• Background in performance optimization, profiling, and cost management in cloud.
• Experience with API-first services, REST/gRPC, and multi-tenant architectures.
• Leadership experience and ability to influence at senior levels, with strong communication.

Responsibilities

• Design and implement large-scale data pipelines on a cloud-native platform.
• Establish reusable architecture patterns for low-latency data analysis at scale.
• Develop REST/gRPC APIs and AI-driven interfaces for data interaction.
• Own platform reliability, scalability, performance, and cost efficiency.
• Build fault-tolerant systems for millions of concurrent workloads.
• Collaborate with cloud, engineering, product teams to translate requirements.
• Drive transition of concepts into production-grade software.
• Set technical direction through reviews, mentoring, and rapid prototyping.
• Collaborate with globally distributed teams with a customer-focused approach.

Skills

Docker

Kubernetes

Python

Cloud data platforms

API design

Data lakehouse

Spark/Trino/Databricks

Parquet/columnar formats

C/C++

Observability/telemetry

Education

Bachelor's in CS/Engineering or related

Master's or PhD advantageous

Tools

Apache Iceberg

Delta Lake

Apache Arrow

DuckDB

Velox

Job description

Responsibilities

• Design and implement large-scale data processing pipelines capable of handling millions of records across a cloud-native data platform.
• Establish standardized and reusable architecture patterns for low-latency data analysis and querying at petabyte scale.
• Design and deliver REST/gRPC APIs, web applications, and natural-language/AI-driven interfaces that enable users to interact with large datasets efficiently.
• Own the reliability, scalability, performance, and cost efficiency of the platform, including workload orchestration, monitoring, debugging, and optimization.
• Design systems capable of supporting millions of concurrent workloads, with strong fault tolerance, resiliency, reproducibility, and operational visibility.
• Partner with cloud infrastructure, engineering, product, and other technical teams to translate complex business requirements into scalable product architectures and realistic delivery plans.
• Drive the transition of innovative technical concepts and prototypes into commercial-grade, production-ready software solutions.
• Set technical direction and raise engineering standards through architecture reviews, design reviews, mentoring, hands-on development, and rapid prototyping.
• Collaborate effectively with globally distributed teams and maintain a strong customer-focused approach to product and technology development.

Requirements

• Degree in Computer Science, Computer Engineering, Mathematics, or a related technical discipline.
• Proven experience designing and delivering large-scale data-intensive production software in the cloud using AWS, Azure, or GCP.
• Strong hands-on experience with Docker, Kubernetes, infrastructure automation, and CI/CD.
• Deep knowledge of modern data lake and lakehouse architectures, including Apache Iceberg or Delta Lake, catalog services, snapshot management, partitioning, data pruning, compaction, and schema evolution.
• Strong understanding of columnar data formats such as Parquet and distributed query engines such as Spark, Trino, or Databricks.
• Strong algorithms and systems engineering foundation, with proven ability to develop performance-critical software in C/C++, including concurrency, memory management, vectorization, and SIMD.
• Experience working with columnar and vectorized processing technologies such as Apache Arrow, DuckDB, or Velox.
• Proven track record of profiling and optimizing large-scale systems for runtime, memory, I/O, scalability, and cloud infrastructure costs.
• Strong proficiency in Python for rapid prototyping, data processing, automation, and production tooling.
• Experience designing and operating distributed batch processing and workflow systems handling very large numbers of concurrent jobs.
• Strong understanding of production observability, including metrics, tracing, structured logging, retries, checkpointing, idempotency, and failure recovery.
• Experience with workflow orchestration and execution environments such as Kubernetes or cloud-based batch processing platforms.
• Experience designing and delivering API-first services, including REST/gRPC, API versioning, backward compatibility, authentication, authorization, and multi-tenant architectures.
• Sufficient full-stack experience to collaborate effectively on modern web applications and data-intensive user interfaces.
• Experience developing highly reliable and reproducible software, including automated testing, benchmarking, validation, and performance testing.
• Proven ability to provide technical leadership and influence at senior level, with excellent communication and stakeholder management skills.
• Demonstrated experience using AI-powered development tools to accelerate and improve the software development lifecycle, engineering productivity, and software quality.

Experience / Education

• Typically requires a minimum of 12 years of relevant experience with a Bachelor's degree, or 8 years with a Master's degree, or a PhD with 5 years of relevant experience; equivalent experience may also be considered.
• Demonstrated track record of leading complex technical initiatives from concept and prototyping through production deployment and commercialisation.

EA License: 21C0783

EAP Registration No: R24123529