Senior Data Engineer — Remote, Spark/EMR & AI Workflows

INGEPSY; Risaralda; Presencial; COP 120.000.000 - 150.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Competitive compensation

Remote work with flexible hours

Modern, impactful projects

Collaborative culture

Well-being support

Descripción de la vacante

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and work closely with AI and product teams to operationalize model-enabled use cases.

This role emphasizes architecture mindset, handling data-intensive environments, and ensuring data quality with governance and security considerations. Remote work with flexible hours and global impact await.

Formación

• 4+ years of software or data engineering experience.
• Strong Spark and distributed data processing experience.
• Experience with Amazon EMR or similar cloud platforms.
• Proficiency in Java or Python.
• Exposure to AI/ML workflows and data preparation for intelligent systems.
• Strong scalability and performance optimization understanding.
• Strong debugging and collaboration skills.
• Upper-intermediate English level.

Responsabilidades

• Design scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with engineering, AI, and product teams to operationalize data-driven use cases.
• Develop data transformation, feature preparation, and AI workflow integration components.
• Optimize pipeline performance, cost efficiency, and reliability.
• Troubleshoot data and application issues across environments.
• Contribute to architecture discussions, documentation, and standards.
• Ensure alignment with data quality, governance, and security expectations.

Conocimientos

Spark and distributed data processing

Amazon EMR

Java or Python

AI/ML workflows

Data architecture

Debugging

Collaboration

English (Upper-intermediate)

Herramientas

Kafka

Airflow

Data lakes

Descripción del empleo

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and work closely with AI and product teams to operationalize model-enabled use cases.

This role emphasizes architecture mindset, handling data-intensive environments, and ensuring data quality with governance and security considerations. Remote work with flexible hours and global impact await.