Senior Big Data Engineer | Remote & Flexible Hours

BairesDev; Colombia; A distancia; COP 283.751.000 - 409.862.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work

Competitive USD compensation

Hardware and software setup

Flexible hours

Paid parental leaves

Mentorship & growth opportunities

Descripción de la vacante

BairesDev is seeking a Big Data Senior to join our Development team and contribute to projects with distributed, multicultural teams worldwide. You will design data pipelines, build Spark jobs, and craft scalable data architectures using Java or Python for batch and real-time ML workloads.

You will optimize Hadoop clusters, perform AWS DevOps tasks to ensure resiliency and security, and mentor other engineers while collaborating with Architects, Data Scientists, Analysts, PMs, and customers.

Formación

• 6+ years of experience as a developer.
• 5+ years of experience in Big Data.
• Proficient with analysis, troubleshooting, and problem-solving.
• Hands-on experience with managing data loads and data quality is a plus.
• Advanced English level.

Responsabilidades

• Identify and recommend technology choices for batch and real-time ML scenarios.
• Write efficient Spark jobs to process TB of data.
• Collect heuristics and optimize Spark jobs on large Hadoop clusters.
• Perform DevOps on AWS to ensure resiliency, availability, security, and HA/DR.
• Partner with an x-functional team of Architects, Data Scientists, Data Engineers, Analysts, PMs, and customers.
• Write clean, efficient code and deployment artifacts in Java or Python, or Chef.
• Teach and mentor other engineers on the team.

Conocimientos

Big Data

Spark

Java

Python

AWS

English

Herramientas

Hadoop

Chef

Spark

Descripción del empleo

BairesDev is seeking a Big Data Senior to join our Development team and contribute to projects with distributed, multicultural teams worldwide. You will design data pipelines, build Spark jobs, and craft scalable data architectures using Java or Python for batch and real-time ML workloads.

You will optimize Hadoop clusters, perform AWS DevOps tasks to ensure resiliency and security, and mentor other engineers while collaborating with Architects, Data Scientists, Analysts, PMs, and customers.