Remote Big Data Engineer — Spark, Hadoop, Scale

BairesDev; Mexico; On-site; PHP 5,474,000 - 7,908,000; Full time

Job summary

BairesDev is seeking a Software Engineer specializing in Big Data to design and maintain high-capacity data platforms that support the company’s global operations. The role focuses on transforming raw data streams into structured assets and ensuring distributed systems run reliably.

You will design scalable data architectures using Hadoop and Spark, implement ingestion pipelines with NiFi and Kafka, and optimize Linux-based clusters.

Qualifications

• 4+ years of experience in Software/Data Engineering or Big Data.
• Experience building and operating big data platforms with Hadoop ecosystem.
• Proficiency in Java or Scala for high-performance processing.
• Hands-on experience with Spark, HBase, NiFi, and Kafka at large scale.
• Strong Linux administration and distributed data environments.

Responsibilities

• Design and implement scalable Big Data architectures using Hadoop ecosystem.
• Develop high-performance data processing components in Java or Scala.
• Optimize storage and compute for petabyte-scale data.
• Build robust data ingestion pipelines with NiFi and Kafka.
• Manage and troubleshoot large-scale clusters for high availability.
• Maintain system integrity through Linux administration and performance tuning.

Skills

Big Data

Java/Scala

English

Linux administration

Tools

Hadoop

Spark

HBase

NiFi

Kafka

Job description

BairesDev is seeking a Software Engineer specializing in Big Data to design and maintain high-capacity data platforms that support the company’s global operations. The role focuses on transforming raw data streams into structured assets and ensuring distributed systems run reliably.

You will design scalable data architectures using Hadoop and Spark, implement ingestion pipelines with NiFi and Kafka, and optimize Linux-based clusters.