Remote Senior Data Engineer: Spark, EMR & AI Pipelines

AgileEngine; Pereira; Presencial; COP 376.896.000 - 471.120.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth budget

Competitive compensation

Remote work 100%

Flexible hours

Global teams

Descripción de la vacante

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

The role emphasizes strong architecture sense, data-intensive environments, and execution focus, with 100% remote flexibility and a global impact across projects.

Formación

• 4+ years of software or data engineering experience.
• Strong experience with Spark and distributed data processing.
• Experience with Amazon EMR or similar cloud-based data processing platforms.
• Proficiency in Java, Python, or related programming languages.
• Exposure to AI or machine learning workflows, model integration, or data preparation for intelligent systems.
• Strong understanding of scalable data architecture and performance optimization.
• Strong debugging and collaboration skills.
• Comfortable delivering in evolving, data-intensive environments.
• Able to bridge software engineering and data engineering responsibilities.
• Strong execution focus with practical architecture sense.
• Upper-intermediate English level.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with engineering, AI, and product teams to operationalize data-driven and model-enabled use cases.
• Develop software components for data transformation, feature preparation, and AI workflow integration.
• Optimize pipeline performance, cost efficiency, and production reliability.
• Troubleshoot data and application issues across development and production environments.
• Contribute to architecture discussions, documentation, and engineering standards.
• Ensure solutions align with data quality, governance, and security expectations.

Conocimientos

Spark

Python

Java

Data architecture

Performance optimization

Debugging

Collaboration

English proficiency

Herramientas

Amazon EMR

Descripción del empleo

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

The role emphasizes strong architecture sense, data-intensive environments, and execution focus, with 100% remote flexibility and a global impact across projects.