Sr. DevOps Engineer – BigData platforms and cloud infrastructure (Remote)

Stage 4 Solutions; United States; Remote; USD 80,000 - 100,000; Full time

Job summary

A leading global B2B high-tech company seeks a Sr. DevOps Engineer to oversee its BigData platforms and cloud infrastructure. This remote 5-month contract role demands strong expertise in performance tuning, data governance, and cloud services, with a competitive hourly rate and excellent benefits offered.

Benefits

Health benefits

401K

Qualifications

• Over 7+ years in DevOps/SRE, focusing on big data platforms.
• Knowledge of MLOps and data ingestion processes.
• Hands-on experience with data processing and cloud infrastructure.

Responsibilities

• Maintain and support a dedicated data environment.
• Monitor and optimize system performance.
• Develop CI/CD pipelines for automated deployment.

Skills

Performance tuning

Access control

Data governance

Cloud infrastructure

Automation

Collaboration

Scripting

Education

B.S. or Master's Degree in Computer Science or related field

Tools

Kubernetes

Docker

Apache Spark

Kafka

Airflow

Hadoop

Git

Job description

Sr. DevOps Engineer – BigData platforms and cloud infrastructure (Remote)

Sr. DevOps Engineer – BigData platforms and cloud infrastructure (Remote)

We are seeking a Sr. DevOps Engineer for a large, global B2B high-tech company. In this role, you will be responsible for maintaining and supporting a dedicated data environment within BigData infrastructure. You will be doing capacity planning and data pruning, database administration and performance tuning for various tables and queries.

This is a 5-month contract (Extension and conversion possible). 40-hour-per-week remote role in the US.

This is a W2 employee of Stage 4 Solutions. Health benefits and 401K are offered.

Responsibilities

• Performance tuning for various tables and queries.
• Responsible for access control, secrets management, and enforcing compliance with data governance policies.
• Support various CFI data management and data ingestion projects.
• Continuously monitor and optimize system performance and reliability.
• Diagnose and resolve issues in multi-source data ingestion pipelines, ETL processes, and data storage solutions.
• Develop CI/CD pipelines to automate code testing, integration, and deployment processes to ensure rapid delivery of new features.
• Collaborate with data engineering and development teams to integrate changes seamlessly into the deployment pipeline.
  
  

Requirements

• Over 7+ Years of experience in DevOps/SRE function, with at least 3 years emphasizing bigdata platforms, data engineering, and cloud infrastructure services.
• Experienced with designing, building, and maintaining scalable and robust cloud infrastructure using Kubernetes and Docker for containerization and orchestration.
• Knowledge of MLOps platforms and practices
• Hands-on experience with data processing tools like Apache Spark, dbt, Kafka, and Airflow.
• Strong knowledge of Hadoop components, including Spark Streaming, HDFS, HBase, YARN, Hive, Impala, Atlas, and Kudu.
• Familiarity with Snowflake and Clickhouse. Trino, starburst, and data lakehouse technologies
• Experience in securing the Hadoop stack using Sentry, Ranger, LDAP, and Kerberos KDC.
• Skilled in leveraging Software Configuration Management (SCM) and build tools like Git, GitLab, Nexus, Maven, Grunt, Jenkins, Docker, and Ansible for ongoing CI/CD operations.
• Good knowledge of CentOS 7.x and Linux system administration
• Strong experience with scripting languages for automation, such as Python, Bash, Go, Groovy, and YAML, for Big Data cluster deployment and monitoring automation.
• Ability to learn quickly in a fast-paced, dynamic team environment.
• Strong communication skills and the ability to work collaboratively
• Software development background with/ experience in OOP languages such as Java, JavaScript, Node.js, a plus.
• B.S. or Master's Degree in Computer Science, related field, or commensurate work experience.
  
  

Please submit your resume to our network at https://www.stage4solutions.com/careers/ (apply to the Sr. DevOps Engineer – BigData platforms and cloud infrastructure (Remote) role).

Please feel free to forward this job post to others you think may be interested.

Stage 4 Solutions is an equal-opportunity employer. We celebrate diversity and are committed to providing employees with an inclusive environment that is free of discrimination and harassment. All employment decisions are based on the job requirements and candidates’ qualifications, without regard to

race, color, religion/belief, national origin, gender identity, age, disability, marital status, genetic information, or other applicable legally protected characteristics.

Compensation: $60/hr. - $69.28/hr.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Engineering and Information Technology

• Industries

  Software Development and IT Services and IT Consulting

Referrals increase your chances of interviewing at Stage 4 Solutions by 2x

Get notified about new DevOps Engineer jobs in United States.

Site Reliability Engineer L4, Netflix Technology Services

United States $126,000.00-$135,900.00 2 weeks ago

Site Reliability Engineer L5 - Open Connect

United States $100,000.00-$720,000.00 3 weeks ago

Junior DevOps Engineer (Remote - Anywhere)

Junior Site Reliability Engineer (Remote)

United States $80,237.00-$139,077.00 2 weeks ago

Missoula, MT $105,000.00-$125,000.00 3 weeks ago

Junior Site Reliability Engineer (Remote)

Washington, DC $150,000.00-$170,000.00 16 hours ago

United States $176,000.00-$210,000.00 4 days ago

United States $170,000.00-$190,000.00 6 days ago

New York City Metropolitan Area 2 weeks ago

United States $75,000.00-$75,000.00 1 day ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.