Principal Resiliency Engineer

The Depository Trust & Clearing Corporation (DTCC); Dallas (TX); Hybrid; USD 120,000 - 160,000; Full time

Benefits offered by this job

Competitive compensation

Comprehensive health and life insurance

Pension benefits

Paid Time Off

Flexible/hybrid work model

Job summary

The Depository Trust & Clearing Corporation (DTCC) is seeking a Principal Reliability Engineer to join our Reliability Architecture team in Dallas, Texas. This pivotal role involves shaping enterprise observability and enhancing resilience in cloud-native environments.

You will lead the development of prototype workloads to demonstrate observability strategies while collaborating with teams and vendors. Desired candidates should have a Bachelor's degree in computer engineering and at least 8 years of experience in distributed applications.

DTCC offers competitive compensation, comprehensive benefits, and a hybrid work model.

Qualifications

• Minimum 8 years in distributed application design and implementation.
• Experience in enterprise Java technologies and open standards.
• Strong troubleshooting and performance analysis skills.

Responsibilities

• Build and deploy prototype applications showcasing observability capabilities across hybrid environments.
• Conduct rigorous testing with simulated disruptions and environmental failures.
• Collaborate to integrate observability into real workloads.
• Produce runbooks and guidance to support enterprise enablement.
• Provide feedback to influence enterprise strategy.
• Conduct technical evaluations of proposed observability standards.
• Host retrospectives and demos for validation and adoption.

Skills

Enterprise Java technologies

Infrastructure architecture

Database architecture

Containers and cloud-based solutions

Troubleshooting skills

Java

Python

Bash

SQL

CI/CD pipelines

Automation frameworks

OpenTelemetry

Chaos engineering tools

AWS cloud

Azure cloud

Infrastructure as Code

Container orchestration

Education

Bachelor’s degree in computer engineering

Job description

Are you ready to make an impact at DTCC? Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills and drive to make a real impact. We foster a thriving internal community and are committed to creating a workplace that looks like the world that we serve.

The Information Technology group delivers secure, reliable technology solutions that enable DTCC to be the trusted infrastructure of the global capital markets. The team delivers high-quality information through activities that include development of essential building infrastructure capabilities to meet client needs and implementing data standards and governance.

Pay And Benefits

• Competitive compensation, including base pay and annual incentive
• Comprehensive health and life insurance and well‑being benefits, based on location
• Pension / Retirement benefits
• Paid Time Off and Personal/Family Care, and other leaves of absence when needed to support your physical, financial, and emotional well‑being.
• DTCC offers a flexible/hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third day unique to each team or employee).

The Impact You Will Have In This Role

We are seeking a Principal Reliability Engineer to join our Reliability Architecture team and play a pivotal role in shaping the future of enterprise observability. This hands‑on engineering role is designed for a candidate who thrives in fast‑paced, collaborative environments and is eager to influence architectural standards across the organization. You will engineer prototype workloads that simulate real‑world business applications, demonstrating how proposed resiliency and observability strategies and standards can be embedded into modern, cloud‑native environments. Your work will directly support enterprise‑wide adoption of our observability mandate and contribute to platform modernization and resiliency goals.

Primary Responsibilities

• Build and deploy prototype applications that showcase observability capabilities across hybrid environments (on‑premises, AWS, Azure, SaaS).
• Conduct rigorous testing with simulated disruptions, environmental failures, and performance scenarios to validate proposed observability standards.
• Collaborate with platform teams, application owners, and external vendors to integrate observability into real workloads.
• Produce runbooks, configuration guides, architectural patterns, reusable dashboards, and findings to support enterprise enablement and scale.
• Provide feedback and technical insight to IT Architecture leadership and teams to influence enterprise strategy.
• Conduct technical evaluations of proposed standards for observability visualization, distributed tracing, enterprise logging, metrics operations, open standards adoption, event correlation, and alerting notification.
• Host sprint retrospectives and demos for engineering, business, and executive stakeholders to validate and promote adoption.

Qualifications

• Minimum of 8 years in distributed application design and implementation
• Bachelor’s degree in computer engineering or equivalent experience

Talents Needed For Success

• 5+ years in enterprise Java technologies and open standards
• 5+ years in infrastructure, networking, middleware, and database architecture
• 5+ years in highly available architecture and disaster recovery
• 3+ years in containers and cloud‑based solution delivery
• Strong troubleshooting and performance analysis skills
• Java, Python, Bash, SQL
• CI/CD pipelines and automation frameworks (e.g., Jenkins, Selenium)
• OpenTelemetry, distributed tracing, metrics generation, logging
• Chaos engineering tools (e.g., Gremlin, AWS FIS)
• AWS and Azure cloud environments
• Infrastructure as Code (IaC), container orchestration, hybrid deployments

The salary range is indicative for roles at the same level within DTCC across all US locations. Actual salary is determined based on the role, location, individual experience, skills, and other considerations. We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.