Splunk Staff Software Engineer - Performance Optimization & Innovation (PerfOpt)

541 Cisco Systems Poland sp. Z o.o.; Kraków; Hybrid; PLN 300,000 - 520,000; Full time

Benefits offered by this job

Flexible hybrid work

Career growth

Mentorship opportunities

Job summary

Cisco is seeking a Senior Perf Engineer to join the PerfOpt team. You will drive performance improvements across large distributed systems, profile memory and CPU, and optimize tail latency in production workloads.

You will mentor engineers, collaborate across partner teams, and guide architecture decisions using profiling data, benchmarks, and telemetry. The role offers a flexible hybrid work model and opportunities to influence performance standards at scale.

Qualifications

• Advanced C++ production experience with memory management and performance trade-offs.
• CPU/memory profiling and flamegraph analysis (perf, eBPF, VTune).
• Lock contention resolution and atomic/memory ordering concepts.
• Latency optimization in distributed architectures.
• Benchmarking with sound test design.
• Performance modeling to predict scaling limits.
• Architecture and system design for performance and scalability.
• Docker and Kubernetes in production performance contexts.
• Strong Python for tooling and telemetry pipelines.
• Linux internals: scheduler, memory, I/O, and filesystems.
• Git and CI (e.g. GitLab CI) for automating builds, tests, benchmarks.
• Leadership track record and clear communication.
• AI-savviness in delivery speed and production workflows.
• Mentor and grow engineers.

Responsibilities

• Lead performance work from hypothesis through instrumentation and design to measured customer impact.
• Coordinating across teams as needed to drive performance improvements.
• Design petabyte-scale components for memory, concurrency, I/O, and tail latency.
• Instrument production with telemetry, eBPF, and continuous profiling to measure performance.
• Present evidence-based recommendations to partners and stakeholders.
• Mentor peers and less experienced engineers on the team.

Skills

Advanced C++

Perf profiling

Lock contention

Latency optimization

Benchmarks

Performance modeling

System design

Docker/Kubernetes

Python tooling

Linux internals

Git/CI

Technical leadership

Data-driven decisions

Communication

AI in delivery

Mentoring

Education

Bachelor's degree + 8 years

Master's degree + 6 years

PhD + 3 years

Tools

GitLab CI

Job description

Meet The Team

The Performance Optimization and Innovation (PerfOpt) team improves the Splunk customer experience through deep performance work, and sets Splunk's long-term performance standards through guidelines and design. We work where performance is won or lost: search and indexing hot paths, cache and bloomfilter efficiency, S3 transfer throughput, I/O workload management, and parallelism in the data retrieval path. It's a C++ core moving petabyte-scale data across a large distributed architecture, and the results land in what customers feel - search latency, ingest throughput, and infrastructure cost. We are also the organization's performance center of gravity: the benchmarking, design patterns, and engineering standards other teams adopt come from here.

Your Impact Senior performance engineers advise teams on roadmap and architecture, resolve customer performance issues, and set technical direction across partner teams. Lead performance work from hypothesis through instrumentation and design to measured customer impact, coordinating across teams as needed. Design petabyte-scale components for memory, concurrency, I/O, and tail latency, guiding architecture for scalability and reliability. We use profiling, flame graphs, lock contention analysis, benchmarks, and CI regression gates to identify and prevent performance issues. We instrument production with telemetry, eBPF, and continuous profiling to measure performance in real workloads. Compare performance options, quantify costs and risks, and present evidence-based recommendations to partners. Reusable AI workflows shorten performance analysis from days to hours. Engineers set targets, verify results with profiles and benchmarks, and adjust when evidence falls short. Plan performance work, estimate effort, and lead postmortems to identify root causes and prevent regressions. Mentor peers and less experienced engineers on the team.

Minimum Qualifications

• Technical depth Advanced C++ in production, including memory management, allocators, move semantics, cache-aware structures, and performance trade-offs.
• Deep performance engineering - depth across the below, production experience with several: CPU/memory profiling and flamegraph analysis (perf, eBPF, VTune), including off-CPU and continuous profiling.
• Lock contention resolution - hot mutexes, false sharing, atomics and memory ordering, lock-free techniques and when not to use them.
• Latency optimization in distributed architectures - tail latency, queuing, fan-out amplification, backpressure, critical path analysis.
• Benchmarking - micro and workload benchmarks, sound test design and statistical analysis, sub-system validation CI regression detection.
• Performance modelling - analytical or capacity models that help predict scaling limits and validate measured results.
• Architecture and system design - design and improve existing solutions for performance, scalability and operability, and explain those designs to a critical audience.
• Docker and Kubernetes - performance characterization in containerized environments.
• Strong Python for tooling, benchmark harnesses, telemetry pipelines, and performance data analysis.
• Linux performance internals - scheduler, memory subsystem, page cache, filesystems, block I/O, network stack.
• Git and CI (e.g. GitLab CI) for automating builds, tests, benchmarks, and releases.
• Leadership Track record of informing technical decisions - quantifying trade-offs, surfacing risk early.
• Distilling sophisticated problems into comparable data points without losing the nuance or hiding uncertainty.
• Clear, concise, high-signal communication across audiences - mechanism-level with engineers, trade-off-level with leadership, impact-level with customers.
• AI savviness applied to delivery speed - daily use of AI coding agents on production work, building agentic workflows the team adopts and applying a high bar for verifying AI output against profiles, benchmarks, and telemetry.
• Mentor and grow engineers - coaching junior engineers into ownership, and influencing peers through technical leadership rather than authority.
• Experience Bachelor's plus 8 years of related experience, master's plus 6 years, or PhD plus 3 years.
• Preffered Qualifications Experience with search or storage engines and large-scale data platforms.
• Splunk internals.
• Hardware-level work - SIMD, NUMA, cache/TLB behavior, PGO/LTO, compiler optimization.
• Go, Rust, or another systems language alongside C++.
• AWS, Azure, or GCP -storage, networking, and instance performance characteristics.
• Terraform, Puppet, or Ansible for reproducible performance test environments.

What We Offer You

• Performance problems at a scale very few companies have - petabytes of data, real customers, and measurable impact from every millisecond you remove!
• A constant stream of new things to learn.
• We're always expanding into new areas, bringing in open source projects and giving back, and exploring new technologies.
• Exceptionally versatile and dedicated peers, from engineering to product management to customer support.
• Career growth through technical ownership, leadership opportunities, and coaching.
• A stable work environment with clear ownership and measurable goals.
• Flexible hybrid work model (balanced work-from-home and in-office collaboration)
• Splunk is an equal opportunity employer.
• We welcome applicants of all backgrounds and provide reasonable accommodations throughout the hiring process.
• Benefits include flexible hybrid work, growth and mentorship opportunities, and a collaborative, supportive team.

Splunk is an equal opportunity employer. We welcome applicants of all backgrounds and provide reasonable accommodations throughout the hiring process.

Why Cisco?

At Cisco, we’re revolutionizing how data and infrastructure connect and protect organizations in the AI era – and beyond. We’ve been innovating fearlessly for 40 years to create solutions that power how humans and technology work together across the physical and digital worlds. These solutions provide customers with unparalleled security, visibility, and insights across the entire digital footprint. Fueled by the depth and breadth of our technology, we experiment and create meaningful solutions. Add to that our worldwide network of doers and experts, and you’ll see that the opportunities to grow and build are limitless. We work as a team, collaborating with empathy to make really big things happen on a global scale. Because our solutions are everywhere, our impact is everywhere. We are Cisco, and our power starts with you. Cisconians power the future. We make impact as a team, innovating fast and fearlessly to create meaningful solutions on a large scale. The depth and breadth of our technology doesn't just benefit our customers – it also means limitless opportunities for us to experiment and learn. We understand the power each of our unique backgrounds bring when we work together. Because of that, we have a global network of thinkers, doers, experts, and curious creators who help one another do their life’s best work.