ENTERPRISE Architect

Stellar IT Solutions LLC; Chicago (IL); On-site; USD 150,000 - 210,000; Full time

Job summary

Stellar IT Solutions LLC in Chicago seeks a Senior Cyber Recovery Engineer to lead design, testing, and regulatory-aligned recovery for critical financial systems. You will build IRE/clean room environments, automate recovery pipelines, and coordinate with regulators during examinations.

The role requires hands-on execution, runbooks, and continuous improvement of recovery capabilities in a highly regulated setting.

Qualifications

• 10+ years in infrastructure, platform, or resilience engineering with at least 4 years in a regulated financial entity.
• Hands-on experience implementing and testing cyber recovery in an Isolated Recovery Environment or clean room.
• Direct engagement with financial regulators (OCC, FDIC, Federal Reserve, NYDFS, SEC, FINRA).
• Proficiency with backup/replication platforms: Cohesity, Rubrik, Zerto, Veeam, NetBackup, or similar.
• IaC tooling (Terraform, Ansible) and scripting (Python, Bash, PowerShell) for recovery automation.
• Knowledge of network segmentation and zero-trust as applied to clean room environments.
• Familiarity with FFIEC, NIST CSF, and DORA guidance for operational resilience and recovery.

Responsibilities

• Design, build, and maintain Isolated Recovery Environment (IRE) and clean room infra for recovery exercises.
• Execute end-to-end recovery tests, validating RTOs and RPOs for Tier-1/2 apps.
• Develop and maintain runbooks, playbooks, and automation for core banking systems restoration.
• Lead forensic validation procedures to confirm system integrity before production re-entry.
• Serve as SME during regulatory examinations and prepare evidence packages.
• Architect and operate air-gapped or isolated backup pipelines using immutable storage.
• Integrate recovery automation into CI/CD and IaC pipelines to ensure reproducible environments.

Skills

Infrastructure engineering

Resilience engineering

Regulatory compliance

Cyber recovery

Backup tooling

IaC tooling

Python scripting

Network segmentation

Zero-trust concepts

Disaster recovery

Scripting (Bash/PowerShell)

Tools

Cohesity

Rubrik

Zerto

Veeam

NetBackup

Terraform

Ansible

Job description

Project Overview / Contractor's Role:

The Senior Cyber Recovery Engineer is a hands-on technical leader responsible for designing, implementing, and continuously validating the organization’s ability to recover critical systems and data in the wake of a cyber event. This role sits at the intersection of infrastructure engineering, cybersecurity, and regulatory compliance within a highly regulated financial services environment.

The successful candidate has direct experience operating within financial institution recovery programs, engaging with banking regulators (OCC, FDIC, Federal Reserve, or equivalent), and executing recovery exercises within isolated recovery environments (IRE) and clean room configurations. This is not a theoretical role — we need someone who has run the drills, written the runbooks, and tested the assumptions.

Experience Level: Mid-Senior

Required Qualifications (Must Have):

• 10+ years of infrastructure, platform, or resilience engineering experience, with at least 4 years in a financial institution (bank, broker-dealer, asset manager, or equivalent regulated entity).
• Demonstrated hands-on experience implementing and testing cyber recovery in an Isolated Recovery Environment (IRE) or clean room — not just DR/BC planning.
• Direct experience engaging with financial regulators (OCC, FDIC, Federal Reserve, NYDFS, SEC, or FINRA) in the context of technology examinations or regulatory responses.
• Proficiency with enterprise backup and replication platforms: Cohesity, Rubrik, Zerto, Veeam, Commvault, or NetBackup.
• Working knowledge of IaC tooling (Terraform, Ansible) and scripting (Python, Bash, PowerShell) for recovery automation.
• Strong understanding of network segmentation, identity isolation, and zero-trust concepts as applied to clean room environments.
• Familiarity with ransomware TTPs, destructive malware incident response, and forensic triage in a recovery context.
• Experience with FFIEC guidance, NIST CSF, and/or DORA requirements as they pertain to operational resilience and recovery.

Preferred Qualifications (Nice to Have):

• Experience in a GSIB, SIFI, or Category I–III bank with heightened regulatory scrutiny.
• Certifications: CISSP, CISA, AWS/Azure Disaster Recovery specialty, or vendor-specific backup platform certifications.
• Exposure to DORA (Digital Operational Resilience Act) implementation for EU-facing operations.
• Familiarity with SWIFT, FedWire, or CHIPS recovery considerations for payment system continuity.
• Experience with cyber recovery in hybrid cloud environments (AWS, Azure, or GCP) including cloud-based IRE architectures.
• Background in incident response or cyber threat intelligence with a recovery engineering lens.

Tasks & Responsibilities:

Isolated & Clean Room Recovery

• Design, build, and maintain the Isolated Recovery Environment (IRE) and clean room infrastructure used for cyber recovery exercises and declared events.
• Execute end-to-end recovery testing cycles, validating RTOs and RPOs for Tier-1 and Tier-2 critical applications.
• Develop and maintain recovery runbooks, playbooks, and automation scripts for clean room restoration of core banking systems, trading platforms, and data stores.
• Lead technical forensic validation procedures within the IRE to confirm system integrity prior to production re-entry.

Regulatory Engagement & Audit Readiness

• Serve as a subject matter expert during regulatory examinations, audits, and inquiry responses related to cyber recovery posture (e.g., OCC, FDIC, FFIEC, Federal Reserve, NYDFS).
• Translate regulatory guidance (FFIEC Cybersecurity Assessment Tool, NIST CSF, SR 20-24, DORA where applicable) into actionable recovery engineering requirements.
• Prepare evidence packages, technical narratives, and examination artifacts that demonstrate recovery capability maturity.
• Maintain continuous documentation of control effectiveness, test results, and remediation tracking aligned to regulatory expectations.

Recovery Architecture & Engineering

• Architect and operate air-gapped or logically isolated backup and replication pipelines using immutable storage technologies (e.g., Zerto, Cohesity, Rubrik, NetBackup, Veeam).
• Engineer network segmentation and identity isolation controls within the IRE to prevent lateral movement and re-infection risk during recovery.
• Integrate recovery automation into CI/CD and IaC pipelines using Terraform, Ansible, and scripting (Python/Bash) to ensure reproducible, auditable recovery environments.
• Collaborate with application owners, DBAs, and platform teams to validate application-layer recovery sequencing and dependencies.

Exercise Program & Continuous Improvement

• Own the cyber recovery exercise calendar; design tabletop, simulation, and full-failover scenarios including ransomware, destructive malware, and supply chain compromise.
• Lead post-exercise after action reviews (AARs); track findings to closure and drive measurable improvement in recovery capability.
• Benchmark recovery metrics (RTO, RPO, MTTR) against industry peers and regulatory expectations; report program health to CISO and executive leadership.
• Mentor junior engineers on recovery engineering practices, clean room protocols, and regulatory documentation standard