Senior Software Engineer - Remote Data & AI Pipelines

AgileEngine, LLC.; Capital; Presencial; COP 120.000.000 - 180.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Competitive pay

Remote work

Impactful projects

Collaborative culture

Well-being programs

Descripción de la vacante

AgileEngine, LLC. is seeking a Senior Software Engineer to design scalable data processing systems using Spark and Amazon EMR.

You will build batch and distributed pipelines, collaborating with AI and product teams to operationalize model-enabled use cases in data-intensive environments. You will contribute to architecture discussions, optimize performance and costs, and ensure data quality, governance, and security.

Formación

• 4+ years of software or data engineering experience.
• Strong experience with Spark and distributed data processing.
• Experience with Amazon EMR or similar cloud-based data processing platforms.
• Proficiency in Java or Python.
• Exposure to AI or machine learning workflows, model integration, or data preparation for intelligent systems.
• Strong understanding of scalable data architecture and performance optimization.
• Strong debugging and collaboration skills.
• Able to bridge software engineering and data engineering responsibilities.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with engineering, AI, and product teams to operationalize data-driven and model-enabled use cases.
• Develop software components for data transformation, feature preparation, and AI workflow integration.
• Optimize pipeline performance, cost efficiency, and production reliability.
• Troubleshoot data and application issues across development and production environments.
• Contribute to architecture discussions, documentation, and engineering standards.
• Ensure solutions align with data quality, governance, and security expectations.

Conocimientos

Software engineering

Data engineering

Spark

Java

Python

AI workflows

Data architecture

Herramientas

Amazon EMR

Kafka

Airflow

AWS services

Descripción del empleo

AgileEngine, LLC. is seeking a Senior Software Engineer to design scalable data processing systems using Spark and Amazon EMR.

You will build batch and distributed pipelines, collaborating with AI and product teams to operationalize model-enabled use cases in data-intensive environments. You will contribute to architecture discussions, optimize performance and costs, and ensure data quality, governance, and security.