Lead Observability Engineer (Grafana Cloud)

The Depository Trust & Clearing Corporation (DTCC); Dallas (TX); Hybrid; USD 90,000 - 120,000; Full time

Benefits offered by this job

Competitive compensation

Comprehensive health benefits

Pension/Retirement benefits

Job summary

The Depository Trust & Clearing Corporation (DTCC) is seeking an Observability Engineer to enhance monitoring capabilities for applications and infrastructure. In this role, you will design and implement advanced monitoring solutions and ensure system performance while responding to incidents with a focus on continuous improvement.

Ideal candidates will possess a Bachelor's degree and at least 6 years of relevant experience, particularly with monitoring tools like Splunk and Grafana. The role offers a competitive compensation package and hybrid working arrangements.

Join us in fostering a diverse and inclusive workplace!

Qualifications

• Minimum of 6 years of relevant experience.
• Experience in IT infrastructure, application monitoring, and performance management.
• Strong background in system administration for both Windows and Linux environments.

Responsibilities

• Design and implement monitoring solutions for applications and infrastructure.
• Continuously monitor system performance and analyze trends.
• Respond to incidents and perform root cause analysis.
• Generate and present reports on system performance.
• Provide 24x7 on-call L3 support.

Skills

IT infrastructure

Application monitoring

Performance management

Splunk

Grafana Cloud

Python

AWS

Linux

Analytical skills

Education

Bachelor's degree in Computer Science or equivalent

Tools

Dynatrace

OpenText Operations Bridge Manager

Job description

Pay And Benefits

• Competitive compensation, including base pay and annual incentive
• Comprehensive health, life insurance, and well‑being benefits, based on location
• Pension / Retirement benefits
• Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well‑being
• DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee)

The Impact You Will Have In This Role

As an Observability Engineer on the IT FinSight Delivery team, you will maintain the firm’s application and infrastructure monitoring tools, reporting, and analytics tools. This position primarily focuses on monitoring tools such as Grafana Cloud (SaaS), Dynatrace, OpenText Operations Bridge Manager, and Splunk Cloud.

Your Primary Responsibilities

• Design and implement monitoring solutions for applications and infrastructure to ensure high availability and performance
• Continuously monitor system performance, identify bottlenecks, and analyze trends to proactively address potential issues
• Respond to and manage incidents, perform root cause analysis, and implement corrective actions to prevent recurrence
• Work closely with development, operations, and other IT teams to ensure monitoring solutions are integrated and aligned with business needs
• Select, configure, and maintain monitoring tools and platforms, ensuring they are up-to-date and effective
• Generate and present reports on system performance, incidents, and trends for stakeholders
• Continuously improve monitoring processes and tools to enhance efficiency and effectiveness
• Ensure monitoring solutions comply with security policies and regulatory requirements
• Work on engineering and development focused projects from start to finish with minimal supervision
• Provide technical and operational support for our customer base and other technical areas within the company that utilize our tools
• Perform risk management functions such as reconciliation of vulnerabilities, security baselines, and other risk and audit related objectives
• Handle administrative functions for our tools such as keeping the tool documentation current and handling service requests
• Provide 24x7 on‑call L3 support on a rotational schedule with other team members
• Participate in user training to increase awareness of observability solutions
• Ensure incident, problem and change tickets are addressed in a timely fashion, as well as escalating technical and managerial issues
• Follow DTCC’s ITIL process for incident, change and problem resolution

Qualifications

• Minimum of 6 years of relevant experience
• Bachelor’s degree in Computer Science or any technical field and/or equivalent experience

Talents Needed For Success

• Minimum of 6 years of experience in IT infrastructure, application monitoring, and performance management
• 5+ years’ experience with Splunk engineering/support in a production environment, covering all phases of lifecycle management
• Developed competency with monitoring solutions in a production environment
• Proficiency in using monitoring tools such as Grafana Cloud, Dynatrace, OpenText Operations Bridge Manager, Splunk, and similar tools
• Knowledge of scripting languages like Python, Bash, or PowerShell for automating monitoring tasks and processes
• Experience with cloud platforms such as AWS, Azure, or Google Cloud, including their monitoring and management services
• Understanding of network protocols, configurations, and troubleshooting
• Strong background in system administration for both Windows and Linux environments
• Familiarity with database monitoring and performance tuning
• Strong analytical and problem‑solving skills to identify and resolve issues quickly
• Excellent communication skills to collaborate with different teams and present findings to stakeholders
• Attention to detail to ensure accurate monitoring and reporting
• Adaptability to new technologies and methodologies in a fast‑paced environment
• Self‑starter who continually strives to improve the team’s service offerings and one’s own skillset

The salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.