Staff Engineer - Hadoop Big Data DevOps - Federal - 2nd Shift

ServiceNow; Santa Clara (CA); On-site; USD 158,000 - 278,000; Full time

Job summary

A leading cloud-based platform provider is seeking a Staff DevOps Engineer to support its Big Data Federal Team. This role will focus on providing 24x7 support for Government Cloud infrastructure, automating CI/CD pipelines, and leveraging expertise in Kubernetes and Big Data technologies. A deep understanding of production environments and strong scripting skills are essential. Competitive compensation and comprehensive benefits are offered, including flexible spending accounts and a 401(k) plan.

Benefits

401(k) Plan with company match

Health plans including flexible spending accounts

Flexible time away plan

Qualifications

• 6+ years of experience with HDFS, Yarn, Hive, HBase, Kafka, and PostgreSQL.
• Deep understanding of Kubernetes architecture and operations.
• Strong skills in SQL and data querying.

Responsibilities

• Provide 24x7 support for Government Cloud infrastructure.
• Automate CI/CD data pipelines for applications.
• Resolve critical Big Data pipeline and application issues.

Skills

Kubernetes

Docker

AI integration

SQL

Bash scripting

Python scripting

Linux system administration

CI/CD pipelines

Tools

Hadoop

Prometheus

Grafana

Cloudera Data Platform

Job description

Overview

Company Description

It all started in sunny San Diego, California in 2004 when a visionary engineer, Fred Luddy, saw the potential to transform how we work. Fast forward to today — ServiceNow stands as a global market leader, bringing innovative AI-enhanced technology to over 8,100 customers, including 85% of the Fortune 500. Our intelligent cloud-based platform seamlessly connects people, systems, and processes to empower organizations to find smarter, faster, and better ways to work. Join us as we pursue our purpose to make the world work better for everyone.

Responsibilities

• Staff DevOps Engineer on the Big Data Federal Team to help deliver 24x7 support for Government Cloud infrastructure.
• Provide production monitoring, deployment, maintenance, and support for Big Data infrastructure and applications on ServiceNow Cloud and Azure environments.
• Deploy, scale, and manage containerized applications using Kubernetes, Docker, and related tools.
• Automate CI/CD data pipelines for applications leveraging tools such as Jenkins, Ansible, and Docker.
• Identify and resolve issues within Kubernetes clusters, containerized applications, and CI/CD pipelines; provide expert-level incident support and root cause analysis.
• Apply understanding of networking concepts related to containerized environments.
• Provide production support to resolve critical Big Data pipelines and application issues, collaborating with SRE, CS, Developers, QA, and System Engineering teams to replicate complex issues using broad experience with UI, SQL, Full-stack, and Big Data technologies.
• Enforce data governance policies in Commercial and Regulated Big Data environments.

Qualifications

• Experience integrating AI into work processes, decision-making, or problem-solving, including using AI-powered tools, automating workflows, or analyzing AI-driven insights.
• Deep understanding of Hadoop/Big Data ecosystems.
• 6+ years of experience with systems such as HDFS, Yarn, Hive, HBase, Kafka, RabbitMQ, Impala, Kudu, Redis, MariaDB, and PostgreSQL.
• Hands-on production experience with Kubernetes and a deep understanding of Kubernetes architecture, concepts, and operations.
• Strong SQL and data querying/analysis skills with tools like VictoriaMetrics, Prometheus, Spark, Flink, and Grafana.
• Experience supporting CI/CD pipelines for automated deployment to Kubernetes.
• Strong Linux system administration skills.
• Strong scripting skills in Bash and Python for automation and task management.
• Proficient with Git and version control systems.
• Familiarity with Cloudera Data Platform (CDP) and its ecosystem.
• Ability to learn quickly in a fast-paced, dynamic team environment.

Compensation and Benefits

For positions in the Bay Area, we offer a base pay of $158,500 - $277,500, plus equity (when applicable), variable/incentive compensation and benefits. Sales positions generally offer a competitive On Target Earnings (OTE) incentive compensation structure. The base pay shown is a guideline and total compensation will vary based on qualifications, skill level, competencies and work location. We also offer health plans, including flexible spending accounts, a 401(k) Plan with company match, ESPP, matching donations, a flexible time away plan, and family leave programs (subject to eligibility requirements). Compensation is based on geographic location and is subject to change based on work location.

Equal Opportunity and Accommodations

ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, national origin or nationality, ancestry, age, disability, gender identity or expression, marital status, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [e-mail] for assistance.

Export Control Regulations

For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities.