Senior Observability Engineer

Headway Tek Inc; McLean (VA); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Headway Tek Inc in McLean, VA is seeking a Senior Observability Engineer with 9+ years of experience to design and implement enterprise observability solutions.

The ideal candidate will possess deep expertise in modern observability platforms, application performance monitoring, Open Telemetry implementation and cloud technologies, with a strong focus on improving system reliability, operational efficiency, and user experience.

Qualifications

• 9+ years of experience in Application Performance Monitoring (APM), Observability, and Monitoring Engineering.
• Expertise deploying observability using OpenTelemetry framework.
• Strong onboarding experience for Elastic Cloud, and AWS cloud environments.
• Knowledge of distributed tracing, log analytics, infrastructure and application monitoring, synthetic monitoring, and Real User Monitoring (RUM).
• Experience automating with Python and JavaScript.
• Experience integrating monitoring with Jenkins and CI/CD pipelines.
• Hands-on observability for container-based applications.
• Understanding of SRE principles, cloud-native monitoring, and cost management.

Responsibilities

• Analyze the existing observability solution in Elastic Cloud and identify gaps.
• Document deployment gaps and recommend changes to improve monitoring across applications.
• Implement end-to-end observability for distributed, cloud-native apps; collaborate with development, infrastructure, and operations teams.
• Develop monitoring strategies for infrastructure, applications, logs, traces, metrics, and user experience.
• Migrate monitoring from legacy platforms to modern observability stacks (Dynatrace/Elastic).
• Design Elastic-based monitoring architectures including data pipelines, storage, dashboards, and analytics.
• Build extensions, automation workflows, and synthetic monitoring using Python and JavaScript.
• Integrate observability with CI/CD pipelines to automate monitoring, alerting, and incident management.

Skills

APM & Observability

OpenTelemetry

Elastic Cloud

Distributed tracing

Log analytics

Synthetic monitoring

Real User Monitoring

Python & JavaScript automation

CI/CD pipelines

AWS cloud

Tools

Jenkins

Job description

Role : Senior Observability Engineer
Location:Mclean,VA(Hybrid)
C2C or W2

Already (ESS ,elastic Cloud) already setup by Freddie Mac- So we dont look a person who has Setup knowledge in Elastic Cloud

Our Job to On-board 100 Plus legacy and Micro Service Bases application In Elastic Cloud for observability

Since this application are in AWS cloud and hosted in Container - They should have Kubernetes in AWS cloud and Kuberneties

Knowledge in Python and Java script to build API to Emit Logs, Traces to ElastIc cloud

Job Summary

We are seeking a highly skilled Senior Observability Engineer with 9+ years of experience in designing, implementing, and optimizing enterprise observability solutions. The ideal candidate will possess deep expertise in modern observability platforms, application performance monitoring, Open Telemetry implementation and cloud technologies, with a strong focus on improving system reliability, operational efficiency, and user experience.

Key Responsibilities

• Analyze the existing observability solution deployed in Elastic cloud and understand the gap;
• Document ideal scenario versus existing deployment and recommend the changes required to bring the Observability solution to improve overall application monitoring
• implement end-to-end observability solutions for distributed and cloud-native applications; Work with development, Infrastructure and application support team to streamline the application monitoring using Elastic Cloud
• Develop comprehensive monitoring strategies covering infrastructure, applications, logs, traces, metrics, and user experience.
• Migrate application monitoring from legacy monitoring platforms (Dynatrace, Splunk, Prometheus ) to modern observability platforms such as Dynatrace and Elastic.
• Design and implement Elastic-based monitoring architectures, including data pipelines, storage, APM, dashboards, and advanced analytics.
• Build custom extensions, automated workflows, and synthetic monitoring solutions using Python and JavaScript.
• Integrate observability platforms with CI/CD pipelines (Jenkins and related tools) to automate monitoring, alerting, and incident management.
• Configure OpenPipeline, Business Events, anomaly detection, and AI-driven analytics to improve operational visibility.
• Optimize observability platform licensing, data ingestion, and storage costs while maintaining monitoring effectiveness.
• Collaborate with Development, Infrastructure, and Operations teams to improve application reliability, performance, and operational excellence.
• Conduct dashboard reviews, monitoring assessments, and observability maturity improvements across enterprise applications.
• Support proactive monitoring, root cause analysis, incident response, and continuous service improvement initiatives.

Required Skills & Qualifications

• 9+ years of experience in Application Performance Monitoring (APM), Observability, and Monitoring Engineering.
• Excellent knowledge about Deploying observably using Open Telemetry framework
• Strong expertise in onboarding application in Elastic Search ()
• Strong knowledge of:
  • Distributed tracing
  • Log analytics
  • Infrastructure and application monitoring
  • Synthetic monitoring
  • Real User Monitoring (RUM)
• Experience developing automation using Python and JavaScript.
• Experience integrating monitoring platforms with Jenkins and CI/CD pipelines.
• Hands on experience in implementing Observability for Container based application
• Strong understanding of observability architecture, SRE principles, and cloud-native monitoring practices.
• Hands-on experience with AWS cloud platforms.
• Knowledge of anomaly detection, Open Pipeline configuration, Business Events, and AI-assisted observability.
• Strong analytical, troubleshooting, and root cause analysis skills.
• Experience designing scalable enterprise observability architectures.
• Knowledge of license optimization and observability cost management.
• Experience implementing AI-driven observability and automated incident management.
• Excellent communication, stakeholder management, and cross-functional collaboration skills.
• Passion for driving operational excellence through automation, proactive monitoring, and observability best practices.