Hadoop Engineer - Remote work | REF#308682

BairesDev; Brasil; Remote; BRL 493,000 - 712,000; Full time

Benefits offered by this job

Remote work

USD/Local currency pay

Home office setup

Flexible hours

Parental leaves

Mentorship and growth

Job summary

BairesDev is seeking a Hadoop Engineer to design and operate large-scale data platforms using the Hadoop ecosystem, Spark, Kafka, NiFi, and related technologies. You will build scalable data pipelines and manage distributed Linux clusters.

This role offers 100% remote work, competitive USD or local currency pay, home setup, flexible hours, parental leaves, and a multicultural, mentorship-driven environment with opportunities for growth.

Qualifications

• 4+ years of experience in Data Engineering, Software Engineering, or Big Data.
• Experience building and operating big data platforms using the Hadoop ecosystem.
• Proficiency in Java or Scala and hands-on experience with Spark, HBase, and NiFi.
• Strong background in Linux administration for managing distributed computing environments.
• Experience with real-time data integration and messaging technologies like Kafka.
• Advanced proficiency in English.

Responsibilities

• Build and operate large-scale big data platforms using Hadoop and Spark.
• Design data integration and messaging solutions with Kafka and NiFi.
• Oversee deployment and tuning of storage layers such as HBase, Ozone, and Impala.
• Maintain distributed Linux environments for maximum cluster uptime.
• Write automation and data processing code in Java or Scala.

Skills

Java

Scala

Spark internals

Hadoop ecosystem

Linux administration

Kafka

English

Tools

HBase

NiFi

Kafka

Spark

Ozone

Impala

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Hadoop Engineer at BairesDev

What You'll Do

• Build and operate large-scale big data platforms using the full Hadoop ecosystem and Spark internals.
• Design and optimize high-throughput data integration and messaging solutions using Kafka and NiFi.
• Oversee the deployment and performance tuning of storage layers including HBase, Ozone, and Impala.
• Maintain and configure distributed Linux environments to ensure maximum cluster uptime and efficiency.
• Write high-quality automation and processing code in Java or Scala to streamline data workflows.

What We Are Looking For

• 4+ years of experience in Data Engineering, Software Engineering, or Big Data.
• Proven expertise in building and operating big data platforms using the Apache Hadoop ecosystem.
• Proficiency in Java or Scala and hands-on experience with Spark internals, HBase, and NiFi.
• Strong background in Linux administration for managing distributed computing environments.
• Experience with real-time data integration and messaging technologies like Kafka.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!