Staff Observability Platform Engineer - Scale & Automation

Intuit, Inc.; United States; Presencial; USD 189 000 - 274 000; Tempo integral

Resumo da oferta

Intuit, Inc. seeks a Staff Software Engineer to join the Core PDX Observability Engineering team to design and deliver a next-generation logging and observability platform.

This role focuses on creating and leading high-scale, mission-critical pipelines across on-premise and public cloud deployments (AWS, GCP). You will own architecture for the One Logging system, driving cost optimization and enabling engineering velocity.

Qualificações

• 8-10+ years of experience in software engineering with large-scale distributed systems.
• Bachelor's degree (BE/BTech/MS/MTech) in Computer Science or related field.
• Deep expertise in building and operating high-throughput data pipelines at multi-TB/PB daily scale.
• Strong hands-on experience with Kubernetes, containerized workloads, and sidecar/daemonset architectures (e.g., Fluent Bit).
• Proficiency with public cloud platforms (AWS — S3, Kinesis, CloudWatch, EC2; GCP — logging/monitoring services).
• Experience with Splunk or equivalent log management/observability platforms at scale.
• Strong programming skills in Go, Java, Python, or similar languages used in infrastructure/platform engineering.
• Demonstrated ability to lead architecture and design for mission-critical, high-availability systems.
• Experience driving cost-optimization initiatives for large-scale infrastructure.
• Strong track record of technical leadership, mentorship, and cross-team influence without direct reporting authority.
• Excellent communication skills — able to translate complex technical tradeoffs for both engineering and leadership audiences.

Responsabilidades

• Architect, build, and evolve the One Intuit Logging system end-to-end from log generation at the edge through ingestion, routing, and storage.
• Own and drive pipeline and cost optimization initiatives across the logging stack, reducing ingestion volume and infrastructure spend without losing signal fidelity.
• Lead design and development of core logging components: Front End Logging Service (FELS), S3 Log Writer, Kinesis/CloudWatch Log Writer, Log Router, Asterias Splunk, GCP Logs Processor, Index Controller, and Asset-to-Log DB.
• Drive the Automation Revamp/Rewrite initiative, modernizing legacy tooling into scalable, maintainable services.
• Design and maintain edge/collection agents — Fluent Bit DaemonSet, OIL sidecar (Fluent Bit), EC2 Logger Agent — and integrate Kubernetes metadata enrichment into the pipeline.
• Build and extend the FELS Onboarding Plugin to streamline developer onboarding to the logging platform.
• Leverage MCP Server capabilities to enable AI-assisted authoring, automation, and operational tooling across the observability platform.
• Build observability into the platform itself — Grafana dashboards, metrics, and alerting for pipeline health, throughput, and cost.
• Partner with platform governance efforts (e.g., SplunkCraft) to enforce ingestion quality, policy, and guardrails upstream in the pipeline.
• Provide technical leadership and mentorship, setting engineering standards and design direction across the team.
• Collaborate cross-functionally with SRE, platform, and product engineering teams to align logging platform capabilities with organization-wide needs.

Conhecimentos

Kubernetes

Go

Java

Python

Cloud platforms

Scripting/DevOps

Cost optimization

Leadership

Splunk

Formação académica

Bachelor's degree in CS or related field

Ferramentas

Fluent Bit

EC2

S3

Kinesis

CloudWatch

Descrição da oferta de emprego

Intuit, Inc. seeks a Staff Software Engineer to join the Core PDX Observability Engineering team to design and deliver a next-generation logging and observability platform.

This role focuses on creating and leading high-scale, mission-critical pipelines across on-premise and public cloud deployments (AWS, GCP). You will own architecture for the One Logging system, driving cost optimization and enabling engineering velocity.