Lead Software Engineer – Enterprise Observability

Humana; United States; Remote; USD 120,000 - 150,000; Full time

Job summary

A healthcare solution company is looking for a Lead Software Engineer to drive the design and implementation of observability and logging platforms. The ideal candidate will have 7+ years of experience in software engineering with a focus on observability and distributed systems. Responsibilities include architecting observability environments and mentoring junior engineers. Excellent programming skills in languages like Python and Java are required. This position is based in the United States.

Qualifications

• 7+ years in software/infrastructure engineering with observability/logging focus.
• Strong foundation in operating systems, networking, algorithms, and distributed systems.
• Proven leadership and mentoring experience.

Responsibilities

• Architect and optimize observability environments through software engineering best practices.
• Build automation scripts and tools to streamline observability instrumentation and deployment.
• Lead the design of distributed systems focused on reliability, scalability, and performance.

Skills

Software engineering best practices

Distributed systems

Programming (Python, .Net, Java, Go, Node.js)

System architecture

CI/CD

Infrastructure as Code

Cloud-native development

API design

Education

Associate degree in Computer Science, Engineering, or related field

Tools

Terraform

Ansible

Azure

AWS

GCP

Splunk

Dynatrace

Grafana

Job description

Become a part of our caring community and help us put health first

Why Join Enterprise Observability Engineering?

The Enterprise Observability Engineering team is a high-impact, high-autonomy group focused on building intelligent, scalable, and resilient observability solutions. We foster a culture of innovation, agility, and ownership—empowering engineers to solve complex problems, drive strategic initiatives, and shape the future of how we monitor and operate distributed systems.

If you're passionate about building tools engineers love, solving unscoped challenges, and leading with technical excellence—this is the team for you.

About the Role

We’re looking for a Lead Software Engineer with deep expertise in logging and observability engineering. You should be fluent in the principles of open telemetry, log ingestion, and event correlation across distributed systems. While familiarity with platforms like Splunk or Dynatrace is a plus, we value platform-agnostic thinking and the ability to design resilient, scalable logging solutions using the best-fit tools for the environment.

As a Lead Software Engineer, you will drive the design, implementation, and evolution of our observability and logging platforms. You’ll lead enterprise-scale initiatives, mentor engineers, and collaborate across disciplines to ensure our systems are reliable, scalable, and performant. Applying deep technical expertise to solve real-world challenges. You’ll work closely with SRE, Security, Networking, Platform Engineering, and Data Science teams to evolve our observability strategy using AI/ML and cloud-native technologies.

Key Responsibilities

• Architect and optimize observability environments through software engineering best practices.
• Build automation scripts and tools to streamline observability instrumentation and deployment.
• Integrate observability into CI/CD pipelines using infrastructure-as-code (IaC) and configuration management tools.
• Conduct observability code reviews and implement automated validation checks.
• Build AI-native tools for autonomous issue detection and resolution.
• Lead the design of distributed systems focused on reliability, scalability, and performance.
• Manage data routing, transformation, and endpoint monitoring integrations.
• Mentor junior engineers and foster a culture of continuous improvement.
• Collaborate across teams to align observability strategies with business goals.
• Communicate technical insights and recommendations to leadership.

Required Qualifications

• Associate degree in Computer Science, Engineering, or related field.
• 7+ years in software/infrastructure engineering with observability/logging focus.
• Strong foundation in operating systems, networking, algorithms, and distributed systems.
• Expertise in:
• Programming (eg. Python, .Net, Java, Go, Node.js)
• System architecture and AI Ops
• CI/CD (eg. GitHub Actions, Azure DevOps)
• Infrastructure as Code (eg. Terraform, Ansible)
• Cloud-native development (eg. Azure, AWS, GCP)
• API design (eg. REST, gRPC)
• Proven leadership and mentoring experience.
• Agile delivery experience and strategic thinking around observability maturity.

Preferred Qualifications

• 5+ years with a technical bachelor’s degree
• Open telemetry
• Experience with Splunk Enterprise & ES (SPL, dashboards, correlation searches, data models)
• Scaled and complex Data onboarding (HEC, UF, TA development)
• Integration with SNOW, SOAR, ITSM/SecOps tools
• Experience with Dynatrace, Cribl, Grafana
• Monitoring and alerting strategy design
• Budget management and cost optimization
• Automation and continuous delivery practices
• Leading cross-functional programs across technologies

Equal Opportunity Employer

It is the policy of Humana not to discriminate against any employee or applicant for employment because of race, color, religion, sex, sexual orientation, gender identity, national origin, age, marital status, genetic information, disability or protected veteran status. It is also the policy of Humana to take affirmative action, in compliance with Section 503 of the Rehabilitation Act and VEVRAA, to employ and to advance in employment individuals with disability or protected veteran status, and to base all employment decisions only on valid job requirements.