Software Engineer (Apache Hadoop) - Remote Work

BairesDev; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Remote work

Hardware home setup

Flexible hours

Parental leave

Career growth

Job summary

BairesDev is seeking a Software Engineer specialized in Apache Hadoop to design and build large-scale data solutions on Hadoop clusters. You will play a key role in creating robust storage and processing workflows with high performance and scalability for enterprise environments.

In this role, you will deploy production-grade Hadoop clusters, optimize MapReduce jobs, and collaborate with data teams to ensure reliability and data integrity.

Qualifications

• 4+ years of experience in Software Engineering, Data Engineering, or Big Data infrastructure.
• Proven expertise in managing and developing on Hadoop clusters and HDFS storage.
• Proficiency in MapReduce and YARN processing for large-scale data workloads.
• Hands-on experience with the Hadoop ecosystem, including Hive.
• Advanced proficiency in English.

Responsibilities

• Design, deploy, and manage production-grade Hadoop clusters, focusing on HDFS storage and YARN resource management.
• Develop and optimize efficient data processing jobs using MapReduce and Hive to handle petabyte-scale datasets.
• Maintain and scale the broader Hadoop ecosystem of tools to ensure seamless data integration and availability.
• Collaborate with data teams to implement best practices for data partitioning, compression, and cluster performance tuning.
• Ensure system reliability and data integrity through proactive monitoring and troubleshooting of distributed components.

Skills

Hadoop

HDFS

MapReduce

YARN

Hive

Big Data

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Software Engineer (Apache Hadoop) at BairesDev

As a Software Engineer specializing in Apache Hadoop, you will manage and develop large-scale data solutions on Hadoop clusters. You will play a key role in designing robust data storage and processing workflows, ensuring high performance and scalability for enterprise-level data environments.

What You'll Do:

• Design, deploy, and manage production-grade Hadoop clusters, focusing on HDFS storage and YARN resource management.
• Develop and optimize efficient data processing jobs using MapReduce and Hive to handle petabyte-scale datasets.
• Maintain and scale the broader Hadoop ecosystem of tools to ensure seamless data integration and availability.
• Collaborate with data teams to implement best practices for data partitioning, compression, and cluster performance tuning.
• Ensure system reliability and data integrity through proactive monitoring and troubleshooting of distributed components.

What we are looking for:

• 4+ years of experience in Software Engineering, Data Engineering, or Big Data infrastructure.
• Proven expertise in managing and developing on Hadoop clusters and HDFS storage.
• Proficiency in MapReduce and YARN processing for large-scale data workloads.
• Hands-on experience with the Hadoop ecosystem, including Hive.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.