Software Engineer - Data & Scalability Platform (8-12 Yrs)

Cisco; Bengaluru; On-site; INR 3,000,000 - 6,000,000; Full time

Job summary

Splunk is seeking a Software Engineer for the Data & Scalability Platform to own the data plane end to end—from relational/data stores to streaming pipelines and compute workloads. You will ensure correctness, performance, cost-bounded operation, and tenant isolation at production scale.

You will design and operate the backbone for data ingestion, processing, and queryable stores, while collaborating with product teams to build scalable, observable platforms using Python and/or Go, and modern

Qualifications

• Bachelor's degree with 7+ years of related experience, or Master's with 4+ years, or PhD with 1+ year of related experience.
• Strong backend software engineering for scalable, reliable, data-intensive services.
• Experience with large-scale distributed systems and scalability challenges.
• OLTP and analytical stores: PostgreSQL/MySQL and ClickHouse/Druid/BigQuery/Snowflake.
• Production experience with streaming/queueing systems such as Kafka, RabbitMQ, Pulsar, Kinesis.
• Scaling data-processing compute with concurrency tuning and throughput under load.
• Proficiency in Python and at least one of Go/Java/C++.
• Experience with cloud-native tech, Kubernetes, AWS, and GCP.
• Independent design, development, debugging, testing with minimal guidance.

Responsibilities

• Own data stores design, migration safety, and retention.
• Design and operate streaming and queueing backbone from ingest to queryable.
• Build and scale compute pipelines and distributed workers.
• Own end-to-end data performance and optimization.
• Own capacity model, quotas, rate limiting, multi-tenant isolation.
• Drive cost efficiency across the data platform.
• Build and own performance tooling: load testing and benchmarking.
• Observability instrumentation and telemetry pipelines.
• Own data operations: backup/restore, retention, deletion, migration.
• Develop production services in Python/Go with secure coding and tests.
• Debug production issues across stores, queues, and services; on-call ready.
• Mentor through design reviews, code reviews, and documentation.

Skills

Python

Go

Java

C++

PostgreSQL

MySQL

ClickHouse

Druid

BigQuery

Snowflake

Kafka

RabbitMQ

Pulsar

Kinesis

Kubernetes

AWS

GCP

Performance benchmarking

Distributed systems

Education

Bachelor's degree with 7+ years of related experience

Master's degree with 4+ years

PhD with 1+ year of related experience

Tools

Kafka

RabbitMQ

Pulsar

Kinesis

Kubernetes

AWS

GCP

Job description

Meet the Team

The Splunk Agent Resilience team is defining the future of AI resilience. Our team provides scalable, cost-effective evaluation and guardrails that ensure AI agents behave as intended, improving reliability and reducing risks. This unified approach empowers our customers to confidently deploy and manage AI-powered applications with enhanced observability and control.

As a Software Engineer on the Data & Scalability Platform team, you will own the data plane end to end: the stores that hold the data - relational, analytical/columnar, object storage, caches, and queues - the streaming and compute components that move and transform it, and the performance tooling that proves how all of it behaves under load. You will make that data plane correct, fast, cost-bounded, and tenant-isolated at production scale, own the capacity and performance model that says when and how it needs to grow, and partner closely with the product engineering teams that build on top of it.

Your Impact

• Own and evolve the platform's data stores - relational, analytical/columnar, object storage, and caching - including schema design, migration safety, and retention.
• Design and operate the streaming and queueing backbone that carries data from ingest to queryable.
• Build and scale the compute and pipelines that move and transform data, including stream processors, writers, schedulers, and distributed worker fleets.
• Own end-to-end data performance: query and write latency, indexing and sharding strategy, and hot-path optimization.
• Own the capacity model for the data platform, along with quotas, rate limiting, and multi-tenant isolation.
• Drive cost efficiency across the data platform, including cost per unit of telemetry and cost attribution.
• Build and own performance tooling - load testing, profiling, and benchmarking - used to validate scale and guide optimization.
• Build observability instrumentation and telemetry pipelines so platform signals are correct, complete, and affordable.
• Own data operations: backup and restore, retention and deletion, replication, migration and backfill, and data-quality signals.
• Design, develop, test, and maintain production services and internal tooling in Python and/or Go, using secure coding practices and automated tests.
• Debug and resolve complex production issues across data stores, queues, and services, and contribute to monitoring, on-call support, and root-cause analysis.
• Contribute to platform architecture direction and act as a technical resource and mentor through design reviews, code reviews, and documentation.

Minimum Qualifications

• Bachelor's degree with 7+ years of related experience, or Master's degree with 4+ years, or PhD with 1+ year of related experience, in Computer Science, Software Engineering, or a related field.
• Strong backend software engineering experience building, operating, and delivering highly scalable, reliable, production-grade data-intensive services and platforms.
• Proven experience with large-scale distributed systems, including designing and solving complex problems of scalability, availability, performance, reliability, and fault tolerance.
• Hands-on experience operating and tuning both an OLTP database (e.g., PostgreSQL, MySQL) and an analytical, columnar, or time-series store (e.g., ClickHouse, Druid, BigQuery, Snowflake) - schema design, indexing, query tuning, and migration safety.
• Production experience with streaming or queueing systems (e.g., Kafka, RabbitMQ, Pulsar, Kinesis) - partitioning, consumer-group semantics, delivery guarantees, and backlog and dead-letter handling.
• Experience scaling data-processing compute - queue consumers, async task workers, or streaming jobs - including concurrency tuning, batching, backpressure, and throughput behavior under sustained load.
• Strong proficiency in Python and solid experience with at least one additional backend programming language such as Go, Java, C++, or similar.
• Demonstrated performance engineering ability - profiling, benchmarking, and load testing real systems, and turning the measurements into capacity, design, and cost decisions.
• Experience with cloud-native technologies, containerized environments (Kubernetes), and public cloud platforms (AWS, GCP, or similar).
• Demonstrated ability to independently design, develop, debug, test, and maintain software with minimal guidance.

Preferred Qualifications

• Experience running ClickHouse or a comparable columnar store at scale - sharding and replication topology, materialized views, merge and mutation behavior, retention and TTL mechanics.
• Experience owning a capacity model or a FinOps practice: cost per unit of telemetry, cardinality governance, and quota or rate-limit design.
• Experience with multi-tenant isolation and noisy-neighbor mitigation in shared data systems.
• Experience with backup and restore, tested disaster-recovery drills against stated RPO/RTO, and data retention or deletion compliance (e.g., GDPR/DSR hard delete).
• Experience building observabi