Senior Data Engineer (Spark/EMR) - Remote, Flexible Hours

AgileEngine; Capital; Presencial; COP 120.000.000 - 180.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Competitive compensation

Remote work with flexible hours

Modern projects with global teams

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine in Colombia is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

The role requires strong architecture sense, experience with Spark, EMR, and Java/Python, plus a focus on performance and reliability in data-intensive environments.

Formación

• 4+ years of software or data engineering experience.
• Proficiency with Spark and distributed data processing.
• Experience with Amazon EMR or similar cloud platforms.
• Proficiency in Java, Python, or related languages.
• Exposure to AI/machine learning workflows or data prep for intelligent systems.
• Strong understanding of scalable data architecture and performance optimization.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with engineering, AI, and product teams to operationalize data-driven use cases.
• Develop software components for data transformation, feature preparation, and AI workflow integration.
• Optimize pipeline performance, cost efficiency, and production reliability.
• Troubleshoot data and application issues across development and production environments.
• Contribute to architecture discussions, documentation, and engineering standards.
• Ensure solutions align with data quality, governance, and security expectations.

Conocimientos

Spark

EMR

Java

Python

AI workflows

Data architecture

Debugging

Collaboration

Distributed processing

Herramientas

Kafka

Airflow

Descripción del empleo

AgileEngine in Colombia is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

The role requires strong architecture sense, experience with Spark, EMR, and Java/Python, plus a focus on performance and reliability in data-intensive environments.