Senior Splunk & Observability Engineer (AWS/OpenTelemetry)

System One; Lafayette (LA); On-site; USD 120,000 - 180,000; Full time

Job summary

System One is seeking a Senior Splunk & Observability Engineer to support enterprise-scale observability platforms in a predominantly AWS environment. This role is hands-on and spans Splunk administration, AWS production support, observability, and automation.

You will manage Splunk Enterprise on AWS, develop SPL queries, build dashboards, and integrate OpenTelemetry and CloudWatch. Proficiency with Python-based automation and CI/CD tooling is required, with collaboration across security,

Qualifications

• 5+ years of hands on Splunk Enterprise administration and engineering experience in large production environments.
• Strong AWS production experience with EC2, ALB, and CloudWatch.
• Advanced SPL query development and performance optimization.
• Experience with OpenTelemetry and Splunk integration.
• Experience with GitLab, Terraform Enterprise, CI/CD, GitHub, and JSON.
• Ability to lead troubleshooting calls and coordinate across teams.

Responsibilities

• Administer, engineer, upgrade, and support Splunk Enterprise in AWS.
• Deploy, configure, and troubleshoot Splunk components on EC2.
• Manage end-to-end Splunk data lifecycle: ingestion, indexing, search, dashboards, alerts, retention, recovery.
• Develop and optimize SPL queries; troubleshoot performance issues.
• Build enterprise dashboards for production monitoring, resiliency, incident response.
• Lead incident investigations and coordinate across teams.
• Participate in on-call rotation and after-hours support.

Skills

Splunk Enterprise

AWS

OpenTelemetry

Python

SPL queries

GitLab

Terraform

CI/CD

CloudWatch

Troubleshooting

Education

Bachelor's degree

Tools

Terraform Enterprise

GitHub

JSON

Amazon EC2

Job description

System One is seeking a Senior Splunk & Observability Engineer to support enterprise-scale observability platforms in a predominantly AWS environment. This role is hands-on and spans Splunk administration, AWS production support, observability, and automation.

You will manage Splunk Enterprise on AWS, develop SPL queries, build dashboards, and integrate OpenTelemetry and CloudWatch. Proficiency with Python-based automation and CI/CD tooling is required, with collaboration across security,