Senior Big Data Engineer — Remote, Flexible Hours, Spark & AWS

BairesDev; Colombia; Presencial; COP 217.405.000 - 372.694.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work 100%

USD compensation or local currency

Home setup provided

Flexible hours

Parental leave & vacations

Descripción de la vacante

BairesDev in Colombia is seeking a Big Data Senior to join our Development team and work on diverse projects with distributed teams worldwide. You'll tackle large-scale data challenges and contribute to building scalable data pipelines.

The role emphasizes using Spark, Hadoop, AWS, and Python/Java, with opportunities to mentor peers and influence architecture. Remote work, competitive USD compensation, and a collaborative, multicultural environment are offered.

Formación

• 6+ years of experience working as a developer.
• 5+ years of experience in Big Data.
• Proficient with analysis, troubleshooting, and problem-solving.
• Hands-on experience with managing data loads and data quality is a plus.
• Advanced English level.

Responsabilidades

• Identify and recommend the most appropriate paradigms and technology choices for batch and real-time ML scenarios.
• Write highly efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with an x-functional team of Architects, Data Scientists, Data Engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python, or Chef.
• Teach and mentor other engineers on the team.

Conocimientos

Big Data

Spark

Python

Java

AWS

Herramientas

Spark

Hadoop

AWS

Java

Python

Descripción del empleo

BairesDev in Colombia is seeking a Big Data Senior to join our Development team and work on diverse projects with distributed teams worldwide. You'll tackle large-scale data challenges and contribute to building scalable data pipelines.

The role emphasizes using Spark, Hadoop, AWS, and Python/Java, with opportunities to mentor peers and influence architecture. Remote work, competitive USD compensation, and a collaborative, multicultural environment are offered.