Infrastructure Operations Engineer – Production Infrastructure
Location: New York, NY
Compensation: $140,000–$170,000
Job Type: Full-Time
Work Environment: Hybrid- 3 Days Onsite per Week
About the Opportunity
Our client is seeking an experienced Infrastructure Operations Engineer to support the day-to-day operation, maintenance, security, and reliability of critical production and non-production infrastructure.
As a broker-dealer supporting mission-critical trading, clearing, market-connectivity, and regulatory systems, the firm requires a highly reliable infrastructure environment capable of supporting extended-hours and increasingly 24-hour trading operations.
This is a hands-on production infrastructure role — not a desktop support or general Corporate IT position. The Infrastructure Operations Engineer will take ownership of the operational health of the firm's physical and cloud infrastructure, including servers, operating systems, data center equipment, AWS, virtualization, monitoring, security patching, hardware lifecycle, disaster recovery, and infrastructure incident response.
You will work closely with Network Engineering, SRE, DBA, Middleware, Information Security, Development, Trade Support, and external vendors to ensure infrastructure issues are identified, resolved, and prevented from recurring.
Key Responsibilities
Infrastructure Operations & Production Support
- Operate and maintain production, UAT, development, and disaster-recovery infrastructure across data centers and cloud environments.
- Monitor infrastructure health, capacity, availability, and performance and proactively identify operational risks.
- Respond to infrastructure alerts, production incidents, hardware failures, operating-system issues, and environmental problems.
- Participate in incident response, root-cause analysis, and remediation of production issues.
- Perform infrastructure changes in accordance with established change-management and production-support procedures.
- Maintain accurate infrastructure inventory, configuration records, documentation, and operational runbooks.
- Partner with SRE and Technical Operations teams to improve monitoring, alerting, automation, and operational visibility.
- Participate in an on‑call/escalation rotation supporting mission‑critical trading systems.
- Own infrastructure issues through resolution rather than simply transferring problems between teams.
Server & Operating System Administration
- Install, configure, maintain, troubleshoot, and upgrade Windows and Linux servers.
- Perform operating‑system upgrades, configuration changes, system hardening, security patching, and lifecycle management.
- Monitor CPU, memory, disk, filesystem, system services, and other server‑level health indicators.
- Troubleshoot complex operating‑system and infrastructure issues across multiple technology layers.
- Perform vulnerability remediation and work with Information Security to address infrastructure security risks.
Data Center & Hardware Operations
- Support physical server infrastructure and enterprise data center environments.
- Perform server installation, hardware troubleshooting, firmware upgrades, and equipment lifecycle management.
- Coordinate with vendors on hardware support, maintenance, and replacement.
- Support data center infrastructure and environmental monitoring as needed.
- Maintain accurate hardware and infrastructure inventories.
Cloud & Virtualization
- Support production infrastructure in AWS and hybrid cloud environments.
- Work with AWS services including EC2, VPC, EBS, S3, CloudWatch, IAM, and related infrastructure services.
- Provision, operate, troubleshoot, and maintain VMware and OpenStack environments.
- Support infrastructure capacity, availability, performance, and lifecycle management across physical and virtual environments.
Monitoring, Observability & Infrastructure Tools
- Configure and support Grafana and Prometheus for infrastructure monitoring, dashboards, alerting, and troubleshooting.
- Support Elasticsearch for logging, search infrastructure, operational monitoring, and troubleshooting.
- Configure and troubleshoot NGINX in production, including reverse proxy, load balancing, TLS, and related infrastructure services.
- Support enterprise secrets and key‑management solutions, preferably HashiCorp Vault.
- Continuously improve infrastructure observability and operational visibility.
Disaster Recovery & Resilience
- Support infrastructure disaster‑recovery and business‑continuity initiatives.
- Maintain and validate infrastructure recovery procedures and documentation.
- Participate in disaster‑recovery testing and remediation activities.
- Help ensure production infrastructure remains resilient, secure, and recovery‑ready.
What We’re Looking For
- 3–5+ years of hands‑on experience in Infrastructure Operations, Systems Engineering, Production Infrastructure, or a similar role.
- Strong hands‑on administration and troubleshooting experience with Windows and/or Linux.
- Experience supporting production infrastructure in a high‑availability environment.
- Hands‑on experience with physical servers and enterprise data center environments.
- Strong understanding of TCP/IP, DNS, VLANs, routing, firewalls, load balancers, storage, and virtualization.
- Experience with operating‑system upgrades, security patching, vulnerability remediation, and system hardening.
- Production experience with AWS, including EC2, VPC, EBS, S3, CloudWatch, IAM, and related infrastructure services.
- Hands‑on experience with VMware and OpenStack.
- Hands‑on production experience with NGINX.
- Experience with Grafana and Prometheus.
- Experience with Elasticsearch and infrastructure/logging environments.
- Experience with enterprise secrets or key‑management solutions; HashiCorp Vault preferred.
- Working knowledge of backup, disaster recovery, and business continuity.
- Experience working within formal change‑management and production‑support processes.
- Strong troubleshooting and incident‑management skills.
- Strong communication skills and the ability to collaborate across Network Engineering, SRE, DBA, Middleware, Information Security, Development, Trade Support, and vendors.
- Ability to work independently in a fast‑paced, mission‑critical production environment.
The Right Mindset
We are looking for an engineer with a strong ownership and “final‑solver” mentality.
You don't simply identify an issue and hand it off to another team. You stay engaged, collaborate across technical teams, investigate root cause, and drive the issue through resolution.
The ideal candidate is proactive, technically curious, comfortable working under pressure, and understands that production infrastructure is a critical business service.
Preferred Experience
- Financial services, securities brokerage, trading, clearing, or another highly regulated environment.
- Mission‑critical or low‑latency production systems.
- 24x5, 24x6, or 24x7 production environments.
- Infrastructure‑as‑Code or automation using Terraform, Ansible, PowerShell, Python, or Shell scripting.
- Enterprise endpoint/security platforms.
- Data center power and environmental monitoring.
Compensation
$140,000–$170,000 base salary, depending on experience and qualifications.