Lead Site Reliability Engineer

Morgan-Stanley; Town of Islip (NY); On-site; USD 155,000 - 215,000; Full time

Job summary

Morgan Stanley is seeking a Vice President-level Lead Site Reliability Engineer to own production reliability and drive SRE practices across Wealth Management Tech platforms.

You will champion SLIs, SLOs, error budgets, and incident management, while coordinating with engineering, infrastructure, and operations teams to ensure uptime and resilience. The role emphasizes automation, observability, and scalable architectures.

Qualifications

• 10+ years of experience in a production environment with solid software development background.
• 5+ years leading a small to medium team of similar skillsets.
• 5+ years driving SRE principles and Chaos Engineering in cloud environments.
• 2+ years supporting/deploying applications in AWS/GCP.
• 2+ years working with Digital Assets/Blockchain-connected infrastructure.

Responsibilities

• Define and champion SRE principles (SLIs/SLOs, error budgets, incident management).
• Own end-to-end production reliability and triage of critical issues.
• Lead incident response across apps, infra, and vendors until service restoration.
• Advance automation and observability for proactive reliability, reducing MTTR.
• Collaborate with engineering to bake reliability into new services and architectures.

Skills

Production SRE leadership

Chaos Engineering

Cloud (AWS/GCP)

Blockchain/digital assets

Scripting (Shell/Python)

AI for ops

Databases (DB2/Sybase/Oracle)

Observability tools (Grafana/PromQL/S플

Incident management

Team leadership

Education

Bachelor's or Master's in CS/CE

Tools

Grafana

Prometheus

Splunk

Kibana

AWS

GCP

Job description

In the Technology division, we leverage innovation to build the connections and capabilities that power our Firm, enabling our clients and colleagues to redefine markets and shape the future of our communities. This is a Lead Site Reliability Engineering position at Vice President level, which is part of the job family responsible for overseeing the production environment, ensuring the operational reliability of deployed software, and implementing strategies to optimize performance and minimize downtime.Morgan Stanley is an industry leader in financial services, known for mobilizing capital to help governments, corporations, institutions, and individuals around the world achieve their financial goals.Interested in joining a team that’s eager to create, innovate and make an impact on the world? Read on.The Vice President, Site Reliability Engineering (SRE), is responsible for driving the stability, resiliency, availability, and operational excellence of critical Wealth Management Technology platforms. This leader will own end-to-end production reliability, champion SRE best practices, and partner closely with Engineering, Infrastructure, Operations, and Business stakeholders to ensure seamless client and advisor experiences.What you’ll do in the role:Drive Reliability Engineering PracticesChampion SRE principles, including Service Level Indicators (SLIs), Service Level Objectives (SLOs), Error Budgets, and operational risk management frameworks.Define and track reliability metrics that measure platform health, customer experience, and operational effectiveness.Lead initiatives focused on reducing Mean Time to Detect (MTTD), Mean Time to Identify (MTTI), and Mean Time to Restore (MTTR).Own Production ReliabilityProvide leadership for the proactive detection, triage, and resolution of production issues impacting business-critical applications and services.Serve as the primary owner for escalated production incidents, driving resolution efforts across application, infrastructure, vendor, and external partner teams until service is restored and client impact is mitigated.Establish a culture of operational excellence focused on stability, resiliency, and continuous service improvement.Ensure clear, concise, and timely communication during outages, providing accurate business impact assessments and recovery updates to senior leadership.Digital Asset & Ledger IntegrationSupport blockchain-connected infrastructure, node operations, digital wallet security systems, or distributed ledger technology (DLT) pipelines within a regulated framework.Production Governance & Change ManagementServe as a key gatekeeper for the production environment, ensuring adherence to change management policies, release controls, operational readiness standards, and risk management practices.Assess the operational impact of technology changes and ensure appropriate testing, rollback strategies, monitoring, and support models are in place prior to production deployment.Partner with development teams throughout the software lifecycle to ensure reliability, observability, and operational supportability are built into new applications and services.Automation & Operational EfficiencyIdentify opportunities to eliminate manual effort and operational toil through automation, self-healing capabilities, and AI-driven operational workflows.Lead the development and adoption of automation solutions that improve reliability, reduce risk, and increase operational efficiency across the organization.Promote a culture of engineering-led operations and continuous process optimization.Operational Readiness & Knowledge ManagementEstablish and maintain a comprehensive knowledge management framework, ensuring runbooks, troubleshooting guides, standards, and operational procedures are accurate, current, and accessible.Drive operational readiness programs that improve first-level diagnosis and reduce dependency on development teams for routine issue resolution. Create End-to-End Know your system diagrams.Ensure support teams maintain high-quality documentation and standardized troubleshooting practices to accelerate incident resolution.Technical LeadershipAct as a senior technical leader and trusted advisor for reliability, resiliency, observability, and production support strategies.Provide guidance on architecture reviews, platform scalability, capacity planning, disaster recovery, and resiliency testing initiatives.Partner with engineering teams to identify systemic risks and implement long-term solutions that improve platform stability and customer experience.What you’ll bring to the role:10+ years of experience in a production environment with a solid software development background and understanding of performance tuning, end-to-end troubleshooting, networking fundamentals and appropriate attention to detailBS/MS or equivalent, preferably in quantitative discipline (Computer Science, Computer Engineering).5+ years’ experience in leading a small to medium team of alike skillset.5+ years of experience in driving SRE principles and Chaos Engineering and supporting applications in the Cloud.2+ years’ experience with supporting/deploying applications in AWS/GCP Cloud technologies.2+ years’ experience working with Digital Assets/Blockchain-connected infrastructure, digital wallet security systems, distributed ledger technology pipelines.Experienced, technically hands-on professional that understands both code and infrastructure.Strong experience in scripting language (Shell scripting, Python, Perl, etc.) and cloud driven development.Hands-on with AI and implementation of AI tools for operational efficiency.Strong database skills with DB2, Sybase or Oracle.Working knowledge on any of the DevOps & observability tools (Grafana, Prometheus, Splunk, Kibana).Solid analytical skills, problem determination, and resolution recovery processes.Ability to interface and cultivate excellent working relationships with technology teams, business analysts, and vendors.Should be a fast learner of technologies in a quick paced environment.Is driven to learn about new technologies, techniques and what it takes to be an integral member of this team.Hands-on experience administering large-scale, high-availability systems and the tools to monitor performance and availability.Excellent communication and writing skills specific to technical discussions across the management layers.Experience with incident “on call” and ability to respond to emergencies on a 24/7 basis.Strong ownership mentality with a focus on customer satisfaction.Be able to manage an outage incident, coordinating user communications, and other teams to help resolve an incident.Experience working within Financial Services Industry area will be a plus.WHAT YOU CAN EXPECT FROM MORGAN STANLEY:At Morgan Stanley, we raise, manage and allocate capital for our clients – helping them reach their goals. We do it in a way that’s differentiated – and we’ve done that for 90 years. Our values - putting clients first, doing the right thing, leading with exceptional ideas, committing to diversity and inclusion, and giving back - aren’t just beliefs, they guide the decisions we make every day to do what's best for our clients, communities and more than 80,000 employees in 1,200 offices across 42 countries. At Morgan Stanley, you’ll find an opportunity to work alongside the best and the brightest, in an environment where you are supported and empowered. Our teams are relentless collaborators and creative thinkers, fueled by their diverse backgrounds and experiences. We are proud to support our employees and their families at every point along their work-life journey, offering some of the most attractive and comprehensive employee benefits and perks in the industry. There’s also ample opportunity to move about the business for those who show passion and grit in their work.To learn more about our offices across the globe, please copy and paste https://www.morganstanley.com/about-us/global-offices into your browser.Expected base pay rates for the role will be between $155,000 and $215,000 per year at the commencement of employment. However, base pay if hired will be determined on an individualized basis and is only part of the total compensation package, which, depending on the position, may also include commission earnings, incentive compensation, discretionary bonuses, other short and long-term incentive packages, and other Morgan Stanley sponsored benefit programs.Morgan Stanley is an equal opportunity employer committed to building and maintaining a workforce that is diverse in experience and background. Our recruiting efforts reflect our strong commitment to a culture of inclusion, where individuals are hired, developed, and advanced based on their skills and talents.Our workforce reflects a broad cross-section of the global communities in which we operate, bringing a variety of backgrounds, talents, perspectives, and experiences.For more information, please visit : https://www.morganstanley.com/people-opportunities/eeo .