Senior Software Engineer, Data Pipelines (Spark/EMR) Remote

AgileEngine; Medellín; Presencial; COP 90.000.000 - 150.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Competitive compensation

Remote work

Challenging projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

Ideal candidates have 4+ years of experience in software or data engineering, strong Spark expertise, and proficiency in Java or Python. This remote role offers opportunities to work on data-intensive projects with leading brands.

Formación

• 4+ years of software or data engineering experience.
• Strong Spark and distributed data processing experience.
• Experience with Amazon EMR or similar cloud platforms.
• Proficiency in Java or Python.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with engineering, AI, and product teams to operationalize data-driven use cases.
• Develop components for data transformation and AI workflow integration.
• Optimize pipeline performance, cost efficiency, and reliability.
• Troubleshoot data and application issues across environments.
• Contribute to architecture discussions and standards.
• Ensure data quality, governance, and security expectations.

Conocimientos

4+ years experience

Spark

Distributed data processing

Amazon EMR

Java

Python

AI workflows exposure

Data architecture

Debugging & collaboration

English (upper-intermediate)

Herramientas

Kafka

Airflow

MLOps

Observability tooling

Descripción del empleo

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

Ideal candidates have 4+ years of experience in software or data engineering, strong Spark expertise, and proficiency in Java or Python. This remote role offers opportunities to work on data-intensive projects with leading brands.