Sr. DevOps Engineer - Big Data Platform

Horizontal Talent; Orlando (FL); Remote; USD 150,000 - 200,000; Full time

Job summary

Une entreprise dynamique recherche un Sr. DevOps Engineer pour optimiser et maintenir un environnement de données dédié. Ce rôle entièrement à distance offre la possibilité de travailler avec des technologies de pointe. Les candidats doivent avoir une solide expérience en DevOps et dans le cloud, ainsi qu'une expertise en big data.

Qualifications

• Experience extensive en DevOps/SRE, axée sur des plateformes de big data et des infrastructures cloud.
• Expérience pratique avec des outils de traitement de données comme Apache Spark, dbt.
• Compétences en scripting avec Python, Bash, et Go pour l'automatisation.

Responsibilities

• Maintenir et soutenir un environnement de données dédié dans une infrastructure BigData.
• Gérer les pipelines CI/CD pour tester, intégrer, et déployer.
• Surveiller et optimiser les performances du système et la fiabilité.

Skills

Extensive experience in DevOps/SRE

Proficient in designing scalable cloud infrastructure

Experience with data processing tools

Strong knowledge of Hadoop components

Expertise in SCM and CI/CD tools

Proficient in scripting languages

Job description

Join to apply for the Sr. DevOps Engineer - Big Data Platform role at Horizontal Talent

Join to apply for the Sr. DevOps Engineer - Big Data Platform role at Horizontal Talent

Get AI-powered advice on this job and more exclusive features.

Join a dynamic team as a Sr. DevOps Engineer, where you will play a pivotal role in maintaining and optimizing a dedicated data environment. This fully remote position offers the chance to work with cutting-edge technology and collaborate with talented professionals.

Responsibilities

• Maintain and support a dedicated data environment within BigData infrastructure.
• Plan capacity and manage data pruning, while administering databases efficiently.
• Enhance system performance through tuning and optimization of tables and queries.
• Manage access control, secrets, and ensure compliance with data governance policies.
• Support data management and ingestion projects, ensuring seamless integration.
• Monitor and optimize system performance and reliability, resolving issues in data pipelines and storage solutions.
• Develop and manage CI/CD pipelines to automate testing, integration, and deployment processes.
• Collaborate with data engineering and development teams for seamless deployment integration.
  
  
  

Skills

• Extensive experience in DevOps/SRE, focusing on big data platforms and cloud infrastructure.
• Proficient in designing and maintaining scalable cloud infrastructure using Kubernetes and Docker.
• Hands-on experience with data processing tools like Apache Spark, dbt, Kafka, and Airflow.
• Strong knowledge of Hadoop components such as Spark Streaming, HDFS, and Hive.
• Expertise in leveraging SCM and build tools like Git, Jenkins, and Docker for CI/CD operations.
• Proficient in scripting languages such as Python, Bash, and Go for automation.
  
  
  

Preferred Skills

• Experience with MLOps platforms and practices.
• Familiarity with Snowflake, ClickHouse, and data lakehouse technologies.
• Knowledge of securing Hadoop stack using Sentry, Ranger, and Kerberos KDC.
• Background in software development with experience in OOP languages like Java and JavaScript.
  
  
  

We are committed to fostering an inclusive environment where diversity, equity, and inclusion are at the forefront of our company values. We welcome applicants from all backgrounds to apply and join our team.

Once you apply for this position, you may receive a phone call, SMS or email at the time of application from our Virtual AI Recruiter, Alex, to conduct an initial interview.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Contract

Job function

• Job function

  Engineering and Information Technology

• Industries

  Staffing and Recruiting

Referrals increase your chances of interviewing at Horizontal Talent by 2x

Get notified about new DevOps Engineer jobs in Orlando, FL.

Orlando, FL $150,000.00-$200,000.00 2 weeks ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.