Software Engineer (Apache Hadoop) - Remote Work

BairesDev; Colombia; Remote; COP 286,451,000 - 445,590,000; Full time

Benefits offered by this job

Remote work

USD compensation

Home-office setup

Flexible hours

Paid parental leave

Global collaboration

Job summary

BairesDev in Colombia is seeking a Software Engineer specializing in Apache Hadoop to design, develop and optimize large-scale data solutions on Hadoop clusters. You will build robust storage and processing workflows to ensure performance and scalability for enterprise environments.

This role offers 100% remote work, flexible hours, and the opportunity to collaborate with global teams. Strong English communication and 4+ years in data engineering or big data are expected, with a focus on

Qualifications

• 4+ years of experience in Software Engineering, Data Engineering, or Big Data infrastructure.
• Proficiency in managing and developing on Hadoop clusters and HDFS storage.
• Experience with MapReduce and YARN processing for large-scale data workloads.
• Hands-on experience with Hive and Hadoop ecosystem.

Responsibilities

• Design, deploy, and manage production-grade Hadoop clusters with focus on HDFS storage and YARN resource management.
• Develop and optimize data processing jobs using MapReduce and Hive for petabyte-scale datasets.
• Maintain and scale the Hadoop ecosystem to ensure data integration and availability.
• Collaborate with data teams to implement best practices for data partitioning, compression, and cluster performance tuning.
• Ensure system reliability and data integrity through monitoring and troubleshooting distributed components.

Skills

Hadoop Clusters

MapReduce

YARN

Hive

English Proficiency

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Software Engineer (Apache Hadoop) at BairesDev

As a Software Engineer specializing in Apache Hadoop, you will manage and develop large-scale data solutions on Hadoop clusters. You will play a key role in designing robust data storage and processing workflows, ensuring high performance and scalability for enterprise-level data environments.

What You'll Do:

• - Design, deploy, and manage production-grade Hadoop clusters, focusing on HDFS storage and YARN resource management.
• - Develop and optimize efficient data processing jobs using MapReduce and Hive to handle petabyte-scale datasets.
• - Maintain and scale the broader Hadoop ecosystem of tools to ensure seamless data integration and availability.
• - Collaborate with data teams to implement best practices for data partitioning, compression, and cluster performance tuning.
• - Ensure system reliability and data integrity through proactive monitoring and troubleshooting of distributed components.

What we are looking for:

• - 4+ years of experience in Software Engineering, Data Engineering, or Big Data infrastructure.
• - Proven expertise in managing and developing on Hadoop clusters and HDFS storage.
• - Proficiency in MapReduce and YARN processing for large-scale data workloads.
• - Hands-on experience with the Hadoop ecosystem, including Hive.
• - Advanced proficiency in English.

How we do make your work (and your life) easier:

• - 100% remote work (from anywhere).
• - Excellent compensation in USD or your local currency if preferred
• - Hardware and software setup for you to work from home.
• - Flexible hours: create your own schedule.
• - Paid parental leaves, vacations, and holidays.
• - Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• - Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.