Software Engineer (Big Data) - Remote Work

BairesDev; United States; Remote; MXN 1,688,000 - 2,814,000; Full time

Benefits offered by this job

100% remote

Competitive USD compensation

Hardware provided

Flexible hours

Paid parental leave

Multicultural team

Mentorship & growth

Job summary

BairesDev is seeking a Software Engineer (Big Data) to architect and maintain high-capacity data platforms, transforming raw streams into structured assets while ensuring stability and performance of distributed systems.

You will design scalable Hadoop/Spark solutions, develop data processing components in Java or Scala, and implement robust ingestion pipelines with NiFi and Kafka. This is a 100% remote role with competitive USD compensation and a global, multicultural team.

Qualifications

• 4+ years of experience in Software Engineering, Data Engineering, or Big Data.
• Expertise in building and operating big data platforms using the Hadoop ecosystem.
• Proficiency in programming with Java or Scala for high-performance data processing.
• Hands-on experience with Spark internals, HBase, NiFi, and Kafka at large scale.
• Strong background in Linux systems administration and distributed data environments.
• Advanced proficiency in English.

Responsibilities

• Design and deploy scalable Big Data architectures using Hadoop and Spark.
• Develop high-performance data processing components in Java or Scala.
• Optimize distributed storage and compute for petabyte-scale workloads.
• Implement data ingestion and movement pipelines with NiFi and Kafka.
• Manage and troubleshoot large-scale clusters for high availability.
• Maintain system integrity with Linux administration and performance tuning.

Skills

Java/Scala

Spark internals

Hadoop ecosystem

NiFi

Kafka

Linux administration

English proficiency

Tools

Hadoop ecosystem

Spark

NiFi

Kafka

HBase

Linux

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Software Engineer (Big Data) at BairesDev

As a Software Engineer specializing in Big Data, you will architect and maintain high-capacity data platforms that handle massive information flows. You will be responsible for ensuring the stability and performance of distributed systems, transforming raw data streams into structured, accessible assets for the entire organization.

What You'll Do:

• Design and deploy scalable Big Data architectures using the Hadoop ecosystem and Spark.
• Develop high-performance data processing components and reusable frameworks in Java or Scala.
• Optimize distributed storage and compute resources to maintain efficiency at petabyte scale.
• Implement robust data ingestion and movement pipelines using NiFi and Kafka.
• Manage and troubleshoot large-scale clusters to ensure high availability and fault tolerance.
• Maintain system integrity through advanced Linux administration and proactive performance tuning.

What we are looking for:

• 4+ years of experience in Software Engineering, Data Engineering, or Big Data.
• Proven expertise in building and operating big data platforms using the Apache Hadoop ecosystem.
• Proficiency in programming with Java or Scala for high-performance data processing.
• Hands-on experience with Spark internals, HBase, NiFi, and Kafka at large scale.
• Strong background in Linux systems administration and managing distributed data environments.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.