Senior Splunk Engineer

optimum solutions (singapore) pte ltd; Singapore; On-site; SGD 150,000 - 210,000; Full time

Job summary

Optimum Solutions (Singapore) Pte Ltd seeks an experienced Senior Splunk Engineer to design, implement, administer, and support enterprise Splunk infrastructure across hybrid environments, including on-premises data centers and AWS Cloud. The role emphasizes security log onboarding and observability.

You will work with Splunk Architecture and Administration, integrate AWS logs, build automation with Python/Bash, and manage SC4S Syslog architectures.

Qualifications

• Bachelor's degree in computer science, information technology, or related discipline.
• 8+ years IT infrastructure or enterprise logging experience, with at least 5 years in Splunk architecture and administration.
• Hands-on Splunk Enterprise architecture, administration, log management, and onboarding.
• Experience integrating AWS logs (CloudTrail, CloudWatch, VPC Flow Logs) with Splunk.
• Scripting in Python or Bash; configuration management tools (Ansible, Puppet, Terraform); SC4S and advanced Syslog concepts.

Responsibilities

• Design, implement, administer, and maintain enterprise Splunk infrastructure for scalability, availability, and performance.
• Lead application security log onboarding and integrate logs from on-premises and AWS.
• Manage Splunk components: Indexers, Search Heads, Forwarders, and distributed logging.
• Develop automation scripts in Python/Bash and implement configuration management with Ansible, Puppet, or Terraform.
• Design and support scalable Syslog architectures, including SC4S, and troubleshoot log ingestion issues.
• Provide operational support, performance monitoring, root-cause analysis, and CI/CD automation for Splunk deployments.

Skills

Splunk Architecture

Splunk Administration

Python scripting

Bash scripting

Ansible

Puppet

Terraform

AWS log integration

Syslog/SC4S

CI/CD (GitHub Actions)

Education

Bachelor's degree in Computer Science / IT

Tools

SC4S

GitHub Actions

Splunk AppInspect

Job description

Job Summary

We are seeking an experienced Senior Splunk Engineer to design, implement, administer, and support enterprise-wide Splunk infrastructure and operations. The successful candidate will be responsible for application security log onboarding, enterprise log management, observability, and data ingestion across hybrid environments, including on-premises data centers and AWS Cloud.

The role requires strong expertise in Splunk Architecture, Administration, AWS log integration, Syslog infrastructure, and automation to ensure reliable, scalable, and secure enterprise logging operations.

Key Responsibilities

1. Design, implement, administer, and maintain enterprise Splunk infrastructure, ensuring scalability, availability, and performance.
2. Lead application security log onboarding and integrate logs from on-premises data centres and AWS Cloud environments.
3. Manage Splunk components, including Indexers, Search Heads, Forwarders, and distributed logging architecture.
4. Develop automation scripts using Python/Bash and implement configuration management using Ansible, Puppet, or Terraform.
5. Design and support scalable Syslog architectures, including Splunk Connect for Syslog (SC4S), and troubleshoot log ingestion issues.
6. Provide operational support, performance monitoring, root-cause analysis, and CI/CD automation for Splunk deployments.

Requirements

1. Bachelor's degree in computer science, Information Technology, or a related discipline.
2. Minimum 8 years of overall IT Infrastructure, Enterprise Logging, or Systems Engineering experience, including at least 5 years of dedicated Splunk Architecture and Administration experience.
3. Strong hands‑on expertise in Splunk Enterprise architecture, administration, log management, and application security log onboarding.
4. Proven experience integrating AWS Cloud-native logs, including CloudTrail, CloudWatch, and VPC Flow Logs, with Splunk.
5. Strong scripting knowledge in Python/Bash, configuration management tools (Ansible, Puppet, Terraform), and advanced Syslog/networking concepts, including SC4S.
6. Excellent troubleshooting skills; GitHub Actions, CI/CD, Splunk AppInspect, and Splunk/Ansible certifications are advantageous.