Remote Big Data Engineer — Scale Petabytes & Data Pipelines

BairesDev; United States; Remote; MXN 1,688,000 - 2,814,000; Full time

Benefits offered by this job

100% remote

Competitive USD compensation

Hardware provided

Flexible hours

Paid parental leave

Multicultural team

Mentorship & growth

Job summary

BairesDev is seeking a Software Engineer (Big Data) to architect and maintain high-capacity data platforms, transforming raw streams into structured assets while ensuring stability and performance of distributed systems.

You will design scalable Hadoop/Spark solutions, develop data processing components in Java or Scala, and implement robust ingestion pipelines with NiFi and Kafka. This is a 100% remote role with competitive USD compensation and a global, multicultural team.

Qualifications

• 4+ years of experience in Software Engineering, Data Engineering, or Big Data.
• Expertise in building and operating big data platforms using the Hadoop ecosystem.
• Proficiency in programming with Java or Scala for high-performance data processing.
• Hands-on experience with Spark internals, HBase, NiFi, and Kafka at large scale.
• Strong background in Linux systems administration and distributed data environments.
• Advanced proficiency in English.

Responsibilities

• Design and deploy scalable Big Data architectures using Hadoop and Spark.
• Develop high-performance data processing components in Java or Scala.
• Optimize distributed storage and compute for petabyte-scale workloads.
• Implement data ingestion and movement pipelines with NiFi and Kafka.
• Manage and troubleshoot large-scale clusters for high availability.
• Maintain system integrity with Linux administration and performance tuning.

Skills

Java/Scala

Spark internals

Hadoop ecosystem

NiFi

Kafka

Linux administration

English proficiency

Tools

Hadoop ecosystem

Spark

NiFi

Kafka

HBase

Linux

Job description

BairesDev is seeking a Software Engineer (Big Data) to architect and maintain high-capacity data platforms, transforming raw streams into structured assets while ensuring stability and performance of distributed systems.

You will design scalable Hadoop/Spark solutions, develop data processing components in Java or Scala, and implement robust ingestion pipelines with NiFi and Kafka. This is a 100% remote role with competitive USD compensation and a global, multicultural team.