Senior Data Engineer - Remote Spark Pipelines

AgileEngine; Centrosur; Presencial; COP 376.896.000 - 565.344.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth budget/mentoring

Competitive compensation

100% remote with flexible hours

Modern data projects with global teams

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR, building batch and distributed pipelines while collaborating with AI and product teams to operationalize model-enabled use cases.

You will optimize performance, ensure data quality, and contribute to architecture discussions in a fast-paced data-centric environment requiring upper-intermediate English.

Formación

• 4+ years of software or data engineering experience required.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and EMR.

Conocimientos

4+ years experience

Spark

Distributed processing

EMR

Java

Python

AI/ML workflows

Data architecture

Debugging

Collaboration

English

Herramientas

Kafka

Airflow

MLOps

AWS

Descripción del empleo

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR, building batch and distributed pipelines while collaborating with AI and product teams to operationalize model-enabled use cases.

You will optimize performance, ensure data quality, and contribute to architecture discussions in a fast-paced data-centric environment requiring upper-intermediate English.