Data Center Production Operations Engineer

Meta; Papillion (NE); On-site; USD 84,000 - 130,000; Full time

Job summary

Meta is seeking an experienced Production Operations Engineer to join our Data Center team. You will support platform health, perform root-cause analyses, automate hardware and software operations, and collaborate with partners to bring new platforms into sustained mass production.

You should have 5+ years of IT infrastructure experience in data centers, strong Linux skills, and hands-on server hardware knowledge.

Qualifications

• BS/BA/BEng in a technical field or commensurate experience.
• 5+ years IT infra experience in large-scale environments.
• Linux competence for triage, debugging and remediation.
• Hands-on server hardware and storage knowledge.
• Familiarity with electrical, cooling, cabling, security and network interdependencies.
• Experience driving root-cause analysis and technical problem solving.
• Ability to guide external vendors and internal teams.
• Experience with scripting languages for automation.
• Knowledge of IPMI/serial console for out-of-band access.

Responsibilities

• Support platform health by resolving tickets and addressing root causes.
• Perform deep dives into highly technical data center issues.
• Collaborate with cross-functional teams on hardware, process and automation projects.
• Lead introduction of new platforms with partners to speed mass production.
• Use data and tooling to identify issues and communicate with stakeholders.
• Identify hardware corrective actions with internal teams and vendors.
• Influence future design for serviceability.
• Resolve systemic hardware/software issues at scale through scripting and automation.
• Continuously improve processes, tools, and systems for efficiency.
• Use data to maximize server uptime and utilization; monitor failure rates and SLAs.
• Mentor teammates and update tools/runbooks accordingly.
• Provide engineering support to leadership and cross-functional teams.
• Maintain procedures, runbooks and guides.
• Build cross-functional relationships and influence policies.
• Participate in 24/7 on-call rotation and travel up to 15%.

Skills

Linux

Server hardware

Scripting

Automation

Networking

IPMI

Education

BS/BA/BEng in technical field

Tools

Bash

Python

SQL

Go

Job description

Summary:

Meta is seeking a forward thinking experienced engineer to join the Production Operations team within our Data Centers. These Data Centers are the foundation upon which our rapidly scaling infrastructure efficiently operates and upon which our innovative services are delivered. Meta is at the leading edge of the global data center industry both in terms of how data centers are designed and operated. This person should enjoy working in a fast paced, technical environment where adaptability and flexibility will be key to their success. We seek an IT professional with advanced, hands-on technical skills in server hardware and Linux - ideally in a Data Center environment. Having broad knowledge of server administration and participating in projects in a large-scale distributed data center environment is a core competency of this individual. The candidate should also have working knowledge and experience in a few of the following core areas: Hardware repair, OS management, Tooling and Automation, Networking, or Technical Project Management.

Required Skills:

Data Center Production Operations Engineer Responsibilities:

1. Support platform health by successfully resolving and closing tickets, while addressing the overall issue (i.e. addressing root cause) including, but not limited to, remote troubleshooting and physical inspection of services in data halls

2. Participate in deep dives and root cause analysis of highly technical issues within the data center, ranging from automated tooling to hardware failures and network issues

3. Collaborate with cross-functional teams on projects and initiatives related to topics such as process, hardware and automation

4. Point of contact for the introduction of new platforms and hardware to the site, in collaboration with partners and global resources, accelerating the time it takes to bring these products to sustained mass production

5. Use tools and data analysis effectively to identify issues. Take actions to communicate with all stakeholders appropriately and manage or esc

6. Identify corrective actions of hardware issues, work with internal teams and vendors

7. influence future design changes to ensure ease of serviceability

8. Solve systemic hardware and/or software issues at scale using scripting, automation, and tooling to drive global resolution

9. Continuously evaluate and identify areas for improvement in processes, tools, and systems to optimize efficiency and quality of repairs

10. Use data analytics to drive maximum server up-time and utilization rates, understanding hardware failure rates and service level agreements

11. Support and train team members to evaluate and identify better ways to resolve issues, and define updates to tools and processes

12. Provide engineering support and be a go-to technical resource for the team, leadership, and cross-functional teams in operating and maintaining data center servers

13. Maintain and update documentation i.e. procedures, runbooks and guides

14. Build cross functional relationships and influence policies and procedures that improve global data center operations

15. Participate in 24/7 on-call rotation

16. Ability to travel up to 15% of the time

Minimum Qualifications:

Minimum Qualifications:

1. BS, BA or BEng in technical field or commensurate experience

2. 5+ years of technical IT experience within an infrastructure environment, in a role such as Systems Administrator, DevOps Engineer, or Site Reliability Engineer

3. Intermediate-level understanding in Linux (or equivalent OS) in a complex IT environment with the ability to triage, debug, and troubleshoot server issues

4. Hands-on experience and knowledge of server hardware and components, including storage

5. Intermediate-level knowledge of the interdependencies of data center functions and technologies including electrical, cooling, structured cabling, security, and network

6. Experience managing technical issues and driving to the root cause

7. Experience participating in technical projects related to areas such as process improvement, technology, and/or automation

8. Ability to communicate effectively, in a clear and concise manner, appropriately tailoring messages to the audience

9. Intermediate-level knowledge of technologies such as HTTP, DNS, RAID, and DHCP

10. Experience in providing technical guidance to external vendors

11. Experience in debugging, modifying and developing commonly used scripting or programming languages in at least one of these languages: Bash, PHP, Python, SQL, Rust, Go or Perl

12. Knowledge of out-of-band/lights-out server communication methods, such as IPMI and serial console

13. Experience using data and metrics to drive decisions

Preferred Qualifications:

Preferred Qualifications:

1. Experience in fostering growth in others, and driving influence across all organizational levels

2. Experience in a large-scale data center environment

3. Experience with large-scale AI implementations

4. Six Sigma knowledge/certification

Public Compensation:

$83,990/year to $130,000/year + bonus + equity + benefits

Industry:

Internet

Equal Opportunity:

Meta is proud to be an Equal Employment Opportunity and Aff…?

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].