Splunk Administrator (Site Reliability Engineer)

SchoolsFirst Federal Credit Union; Aliso Viejo (CA); On-site; USD 64,609 - 103,375; Full time

Job summary

SchoolsFirst FCU is seeking a Splunk Administrator (Site Reliability Engineer) to deploy and optimize the Splunk platform for enterprise apps, security operations, and observability. You will onboard data, craft SPL queries, and build dashboards to power IT and security functions.

The role requires 5–7 years of relevant experience, strong Java EE/.NET knowledge, and hands‑on experience with Splunk and APM. This is an on‑site position with a 40‑hour workweek and on‑call rotation.

Qualifications

• Bachelor’s degree or equivalent experience in a related field.
• 5–7 years of relevant experience in Splunk/SRE environments.
• Strong knowledge of Java EE and .NET frameworks and debugging tools.
• Experience with Linux (RedHat) and Windows Server environments.
• Security best practices for multi‑tier systems and application security.
• Experience with Splunk and application performance monitoring (APM).

Responsibilities

• Deploy, manage, and optimize the Splunk platform for enterprise apps, security operations, and observability.
• Onboard machine data, build SPL queries, and design dashboards for IT and security functions.
• Monitor environmental health, detect anomalies, and assist in incident triage.
• Serve as SME for Splunk, ensuring reliability, availability, performance, and security.
• Ingest new data sources, normalize data to the Splunk CIM, and manage ingestion pipelines.
• Monitor indexers, search heads, storage, and clustering; resolve bottlenecks.
• Create real‑time dashboards, alerts, reports, and visualizations providing actionable insights.
• Tune SPL searches, optimize queries, and reduce noise; configure automated alerts.
• Support a 24×7 production environment, including on‑call rotation and incident response.
• Lead root‑cause analysis, post‑incident reviews, and corrective actions.

Skills

Java EE

NET Frameworks

Debugging tools

Application tuning

Security best practices

APM experience

Education

High School Diploma or GED

Bachelor’s Degree or equivalent experience

Tools

Docker

Kubernetes

OpenShift

Python

Jenkins

Git

Ansible

Quay

Artifactory

Job description

Splunk Administrator (Site Reliability Engineer)

Pay Range: $46.90 - $75.04 per hour

Scheduled Weekly Hours: 40

Responsibilities

• Deploy, manage, and optimize the Splunk platform for enterprise applications, security operations, and observability practices.
• Onboard machine data, build SPL queries, and design dashboards to power IT and security functions.
• Monitor and report on environmental health of applications, proactively detect anomalies, and engage in incident triage.
• Serve as subject‑matter expert for the Splunk platform, ensuring reliability, availability, performance, and security.
• Ingest and onboard new operational data sources, normalizing and aligning data to the Splunk Common Information Model.
• Monitor platform health (indexers, search heads, storage, clustering, capacity trends) and resolve ingestion bottlenecks or performance issues.
• Create and maintain real‑time dashboards, alerts, reports, and visualizations to provide actionable insight into system health, SLAs, and security events.
• Craft, tune, and optimize SPL searches and scheduled queries to improve performance and reduce noise.
• Configure automated alerts for anomaly detection, downtime, performance degradation, ingestion issues, and cyber threats.
• Support a 24×7 production environment, including on‑call rotation, deployment support, and timely incident response.
• Serve as escalation point for complex application, infrastructure, observability, security, and platform issues.
• Lead incident triage, root‑cause analysis, post‑incident reviews, and corrective action planning.
• Develop solutions to meet technical and business requirements, creating design documents and capacity plans.
• Contribute to automation and efficiency improvements for build‑out components, monitoring coverage, and deployment readiness.
• Maintain configuration documentation, runbooks, SOPs, and knowledge articles.

Qualifications

• High School Diploma or GED required; Bachelor’s Degree or equivalent experience required.
• 5–7 years of relevant experience.
• Strong knowledge of Java EE and .NET frameworks, debugging tools, and application tuning.
• Experience with RedHat Linux and Microsoft Windows Server.
• Understanding of security best practices for multi‑tier systems and application security.
• Experience with application performance monitoring (e.g., Splunk, APM).
• Preferred: experience with Docker, Kubernetes, OpenShift, Python, Jenkins, Git, Ansible, Quay, Artifactory.
• Preferred: experience managing IBM AIX, RedHat, Linux, or Windows servers.
• Excellent oral and written communication, project management, and interpersonal skills.

Benefits & Other Information

100% on‑site, 0% remote.

The organization participates in E‑Verify and is a federal credit union committed to diversity, equity, and inclusion.

EEO Statement

SchoolsFirst FCU is an equal opportunity employer and prohibits discrimination based on veteran status, disability, race, color, religion, sex, national origin, age, sexual orientation, gender identity, political affiliation, or genetic information.