Principal Apache Hadoop Engineer - Remote Work

BairesDev; Bengaluru Urban; Remote; INR 14,354,000 - 22,010,000; Full time

Benefits offered by this job

Excellent compensation in USD or local currency

Paid parental leave and vacation

Innovative and multicultural work environment

Mentorship and growth opportunities

Mentorship and growth opportunities

Job summary

A technology solutions company is seeking a Principal Apache Hadoop Engineer to lead big data projects and mentor engineering teams. This role requires 10+ years in software development, expertise in HDFS and MapReduce, and experience contributing to Apache open-source projects. Candidates should possess advanced English skills and enjoy a supportive, multicultural work environment. Competitive compensation is offered, with opportunities for professional growth.

Qualifications

• 10+ years of experience in software development.
• Strong expertise in big data ecosystem and distributed data processing systems.
• Deep understanding of advanced HDFS architecture and distributed file system concepts.
• Proficiency in MapReduce paradigm and complex parallel processing techniques.
• Proven experience with YARN resource management and large-scale cluster orchestration.
• Core contributions to Apache open source projects (Hadoop, HDFS, Spark, or similar).
• Advanced level of English.

Responsibilities

• Contribute actively to Apache Hadoop and related open source projects.
• Design and optimize big data ecosystem architectures.
• Architect advanced HDFS components for reliable data storage.
• Lead MapReduce paradigm implementation for complex data processing workflows.
• Drive YARN resource management optimization.
• Mentor engineering teams and provide technical leadership.

Skills

Software development

Big data ecosystem expertise

Distributed data processing systems

Advanced HDFS architecture

Proficiency in MapReduce

YARN resource management

Apache open source contributions

Advanced English

Tools

Apache Hadoop

HDFS

Spark

Job description

Join to apply for the Principal Apache Hadoop Engineer - Remote Work role at BairesDev

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Responsibilities

• Contribute actively to Apache Hadoop and related open source projects as a core contributor, spending 20% of your time on upstream development.
• Design and optimize big data ecosystem architectures for large-scale data processing.
• Architect advanced HDFS components to ensure highly reliable distributed data storage.
• Lead MapReduce paradigm implementation for complex scalable data processing workflows.
• Drive YARN resource management optimization for maximum cluster efficiency and performance.
• Mentor engineering teams and provide technical leadership across projects.

What we are looking for

• 10+ years of experience in software development.
• Strong expertise in big data ecosystem and distributed data processing systems.
• Deep understanding of advanced HDFS architecture and distributed file system concepts.
• Proficiency in MapReduce paradigm and complex parallel processing techniques.
• Proven experience with YARN resource management and large-scale cluster orchestration.
• Core contributions to Apache open source projects (Hadoop, HDFS, Spark, or similar).
• Advanced level of English.

How we make your work (and your life) easier

• Excellent compensation in USD or your local currency if preferred.
• Paid parental leave, vacation, and national holidays.
• Innovative and multicultural work environment.
• Collaborate and learn from the global Top 1% of talent in each area.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!

Apply now!

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology

Industries

• Technology
• Information and Media
• Software Development