Lead Software Engineer - Observability Infrastructure Monitoring

Splunk; Washington (District of Columbia); On-site; USD 157,000 - 217,000; Full time

Job summary

Splunk seeks a Lead Software Engineer for its Observability team to enhance infrastructure monitoring tools. The ideal candidate will architect and deliver complex backend systems, influencing product direction while mentoring engineers. Join a passionate team dedicated to delivering the best customer experience.

Benefits

Medical, dental, and vision benefits

401(k) plan and match

Paid time off

Opportunity for equity or long-term cash awards

Qualifications

• Approximately 8-10 years of relevant and proven experience.
• Strong hands-on experience in observability and monitoring in distributed environments.
• Ability to drive architectural decisions and mentor engineers.

Responsibilities

• Lead and organize team processes like sprint planning and backlog refinement.
• Develop new product features, clarify designs, and participate in code reviews.
• Influence product direction and promote innovative ideas.

Skills

Golang

Python

Java

OpenTelemetry

Prometheus

Grafana

Microservices architecture

Cloud native applications

Relational databases

NoSQL databases

Education

Bachelor’s degree in Computer Science, Computer Engineering or related majors

Job description

Lead Software Engineer - Observability Infrastructure Monitoring

Join to apply for the Lead Software Engineer - Observability Infrastructure Monitoring role at Splunk

Lead Software Engineer - Observability Infrastructure Monitoring

1 week ago Be among the first 25 applicants

Join to apply for the Lead Software Engineer - Observability Infrastructure Monitoring role at Splunk

Get AI-powered advice on this job and more exclusive features.

Join us as we pursue our exciting new vision to make machine data accessible, usable, and valuable to everyone. We are a company filled with people passionate about our product and seeking to deliver the best experience for our customers. At Splunk, we’re committed to our work, customers, having fun and most importantly to each other’s success. Learn more about Splunk careers and how you can become a part of our journey!

As applications and systems become more sophisticated and user experience is at high stake, observability - the ability to monitor and understand the systems and how they impact users, becomes one of the biggest challenges for engineering teams. We are building world-class tools to help engineers deliver better, faster, and more reliable applications.

About The Role

Splunk is looking for hardworking and creative full stack Software Engineers to join our Splunk Observability team who will work on systems that empower our customers to quickly detect and resolve their infrastructure and application issues.

You will be a key contributor and lead for the user facing web application for Splunk Observability Infrastructure Monitoring. Splunk’s Observability Suite is a leader in the Gartner Magic Quadrant and Infrastructure Monitoring is one of the most used and popular products in this suite.

Responsibilities

• Operates as a lead engineer, independently executes tasks as determined and owns the outcomes.
• Own and organize processes for the team such as sprint planning, retrospectives, backlog refinements, program increment (PI) planning, and more.
• Understand the business direction and is able to promote innovative ideas and acquire alignment with multi-functional teams; can influence PM on features, product direction and priority.
• Collaboratively lead design discussions under technical purview, ensuring both functional & non-functional requirements (like scale, security, operability, usability, etc) are considered
• Lead the development new product features, clarify and improve designs, help put together a plan for how to make it happen; participate in code review
• Build relationships with cross-area teams to effectively understand dependencies, gain alignments and set up collaborations
• Grow senior engineers through design & code review, tech seminars, mentoring, pair-programming, etc.
• Take actions to improve the team’s engineering and operational practices
  
  

Requirements

• Proven track record of architecting, designing, and delivering complex, large-scale backend systems.
• Expertise in Golang for backend development; experience with Python or Java is a plus.
• Strong hands-on experience with OpenTelemetry, Prometheus, and Grafana for observability and monitoring in distributed environments.
• Deep understanding of microservices architecture and distributed systems, ensuring scalability, performance, and reliability.
• Experience developing cloud native applications in Kubernetes, or Openshift, Server clusters in distributed environments in AWS, GCP clouds or on-prem clusters.
• Rich experience with 1 or more relational databases & NoSQL databases
• Knowledge and experience leveraging AI technologies is a BIG plus and desirable.
• Knowledge and experience using observability tools would be an advantage.
• Ability to drive architectural decisions, set technical direction, and mentor engineers, fostering a culture of excellence and innovation.
• Strong communication skills, both verbal and written.
• Bachelor’s degree in Computer Science, Computer Engineering or related majors; approximately 8-10 years of relevant and proven experience
  
  

We value diversity at our company. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or any other applicable legally protected characteristics in the location in which the candidate is applying. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Splunk, a Cisco company, is an Equal Opportunity Employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, national origin, genetic information, age, disability, veteran status, or any other legally protected basis.

Note

Base Pay Range

SF Bay Area, Seattle Metro, and New York City Metro Area

Base Pay Range $174,800.00 - 240,350.00 per year

California (excludes SF Bay Area), Washington (excludes Seattle Metro), Washington DC Metro, and Massachusetts

Base Pay Range $157,320.00 - 216,315.00 per year

All other cities and states excluding California, Washington, Massachusetts, New York City Metro Area and Washington DC Metro Area.

Base Pay Range $139,840.00 - 192,280.00 per year

Splunk provides flexibility and choice in the working arrangement for most roles, including remote and/or in-office roles. We have a market-based pay structure which varies by location. Please note that the base pay range is a guideline and for candidates who receive an offer, the base pay will vary based on factors such as work location as set out above, as well as the knowledge, skills and experience of the candidate. In addition to base pay, this role is eligible for incentive compensation and may be eligible for equity or long-term cash awards.

Benefits are an important part of Splunk's Total Rewards package. This role is eligible for a competitive benefits package which includes medical, dental, vision, a 401(k) plan and match, paid time off and much more! Learn more about our next-level benefits at https //splunkbenefits.com.

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development, IT Services and IT Consulting, and Technology, Information and Internet

Referrals increase your chances of interviewing at Splunk by 2x

Sign in to set job alerts for “Lead Software Engineer” roles.

Software Engineering Leader - SLS, 3D Imaging, & Point Cloud

Seattle, WA $150,000.00-$250,000.00 1 week ago

Seattle, WA $142,000.00-$211,000.00 4 weeks ago

Senior Software Engineer, Backend - Fintech

Senior Software Engineer, FusionFeed API

Senior Software Engineer I - Full Stack (Remote Eligible)

Bellevue, WA $140,000.00-$200,000.00 2 months ago

Seattle, WA $170,000.00-$230,000.00 5 months ago

Senior Software Engineer I - Learn Team (Remote Eligible)

Bellevue, WA $140,000.00-$185,000.00 1 week ago

Senior Software Engineer, Data Infrastructure

Principal Software Engineer - Full Stack (Remote Eligible)

Bellevue, WA $200,000.00-$270,000.00 1 week ago

Principal Software Development Engineer - AI Platform

Washington, United States $186,700.00-$298,300.00 7 hours ago

Bellevue, WA $200,000.00-$252,500.00 1 week ago

Senior Software Engineer I, Front End - Chart View (Remote Eligible)

Bellevue, WA $140,000.00-$185,000.00 2 weeks ago

Seattle, WA $215,100.00-$318,600.00 1 week ago

Washington, United States $150,000.00-$224,000.00 1 week ago

Seattle, WA $114,200.00-$142,700.00 1 day ago

Redmond, WA $119,800.00-$258,000.00 6 days ago

Bellevue, WA $130,000.00-$180,000.00 4 days ago

Senior Software Engineer-Distributed Inference

Washington, United States $184,000.00-$356,500.00 5 days ago

Seattle, WA $90,000.00-$185,000.00 1 week ago

Seattle, WA $215,100.00-$318,600.00 6 days ago

Greater Seattle Area $222,000.00-$290,000.00 2 weeks ago

Software Engineering Technical Leader- Front End

Seattle, WA $173,100.00-$241,000.00 2 weeks ago

Senior Software Engineer II - GenAI (Frontend)

Senior Software Engineer - Wine Journey (Mobile/React Native)

Seattle, WA $175,000.00-$275,000.00 3 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.