Lead Observability Engineer

Staples India; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Staples India Business Innovation Hub Private Limited is seeking a proficient Splunk Cloud Admin/Architect to design and run scalable Splunk environments in a highly available setup. You will automate deployments and integrate with CI/CD pipelines, cloud services, and ITIL practices to ensure observability across apps and infrastructure.

The role requires hands-on management of data inputs, forwarders, and Splunk Cloud apps, along with expertise in cloud platforms like Azure and GCP.

Qualifications

• Must hold Splunk Certified Admin or Architect.
• Proficient in Python, Bash and automation tools.
• Experience in SAFe environments, PI Planning and ARTs.
• Proficient in managing data inputs and forwarders; secure access controls.
• Experience with Splunk Cloud apps and Azure/GCP cloud platforms.

Responsibilities

• Design, implement, and manage Splunk Cloud environments for scalable log ingestion, indexing, and search performance.
• Ensure high availability, data retention, and disaster recovery strategies.
• Automate configurations and deployments using tools like Terraform, Ansible, Puppet or custom scripts.
• Build and manage integrations with CI/CD pipelines and cloud-native services (GCP, Azure) for real-time observability.
• Develop and maintain Splunk apps and modular inputs to extend platform capabilities.
• Monitor Splunk performance metrics and optimize indexing, search performance, and storage usage.

Skills

Splunk Certified Admin

Splunk Architect

Python

Bash

Automation Tools

Puppet

Ansible

Terraform

Jenkins

SAFe / Agile

Cloud Platforms (Azure, GCP)

Splunk Cloud

Monitoring & Observability

Data Inputs & Forwarders

Security & Access Controls

Tools

Puppet

Ansible

Terraform

Jenkins

Job description

Staples India Business Innovation Hub Private Limited | Permanent

Design, implement, and manage Splunk Cloud environments to support scalable log ingestion, indexing, and search performance.

Ensure high availability, data retention, and disaster recovery strategies are in place.

Automation & Integration

Automate configurations and deployments using tools like Terraform, Ansible, Puppet or custom scripts.

Build and manage integrations with CI/CD pipelines , cloud-native services (GCP, Azure) , ITIL platforms for real-time observability.

Develop and maintain custom Splunk apps and modular inputs to extend platform capabilities.

Monitoring & Optimization

Monitor Splunk performance metrics and proactively optimize indexing, search performance, and storage usage.

Tune data inputs, parsing rules, and indexing strategies to ensure efficient resource utilization .

Implement best practices for data onboarding, including source types, field extractions, and event normalization.

Security & Compliance

Manage user roles, access controls, and authentication mechanisms (SSO, LDAP, SAML).

Ensure compliance with data governance policies and audit requirements through secure logging practices.

Partner with application teams, SREs, and DevOps to onboard new data sources and build meaningful dashboards.

Conduct knowledge-sharing sessions and mentor junior team members on best practices.

Participate in architectural reviews and provide guidance on observability strategies across teams.

Stay current with latest features, releases, and ecosystem tools .

Contribute to the evolution of logging and monitoring standards across the organization.

Identify opportunities to improve operational efficiency through enhanced visibility and automation.

Requirements

• Splunk Certified Admin / Architect
• Proficient in scripting languages (Python, Bash, etc.) and automation tools (Puppet/Ansible/Terraform/Jenkins)
• Experience working within a SAFe environment, including participation in PI (Program Increment) Planning, Agile Release Trains (ARTs), and cross-functional collaboration across teams
• Proficient in managing data inputs and universal forwarders
• Proficient in setting up users, roles, and authentication protocols to ensure secure access control
• Extensive knowledge of Splunk configuration files and their role in customizing deployments
• Experience in installation and management of apps within Splunk Cloud to extend functionality
• Skilled in monitoring, problem isolation, and system health checks to maintain performance
• Deep understanding of cloud platforms like Azure and GCP
• Demonstrated expertise in sizing, planning, and deploying distributed Splunk environments