Senior Data Engineer - Spark, EMR & AI Pipelines (Remote)

AgileEngine, LLC.; Centrosur; Presencial; COP 120.000.000 - 240.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth without limits

Competitive compensation

Flexibility: 100% remote with flexible

Meaningful, modern projects

Collaborative culture

Well-being & support

Descripción de la vacante

AgileEngine, LLC. in Colombia is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and work with AI and product teams to operationalize model-enabled use cases.

You will contribute to architecture, ensure data quality and security, and deliver reliable, cost-efficient solutions across development and production environments.

Formación

• 4+ years of software or data engineering experience.
• Strong experience with Spark and distributed data processing.
• Experience with Amazon EMR or similar cloud data platforms.
• Proficiency in Java or Python.
• Exposure to AI or ML workflows and model integration.
• Understanding of scalable data architecture and performance optimization.
• Strong debugging and collaboration skills.
• Ability to bridge software and data engineering responsibilities.
• Strong execution focus with practical architecture sense.

Responsabilidades

• Design scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with AI, product, and engineering teams to operationalize data-driven use cases.
• Develop data transformation, feature preparation, and AI workflow integration components.
• Optimize pipeline performance, cost efficiency, and production reliability.
• Troubleshoot data and application issues across environments.
• Contribute to architecture discussions, documentation, and standards.
• Ensure solutions meet data quality, governance, and security expectations.

Conocimientos

4+ yrs exp

Spark & distributed processing

Amazon EMR

Java / Python

AI/ML workflows

Scalable data architecture

Debugging & collaboration

Software & data bridge

Execution focus

Descripción del empleo

AgileEngine, LLC. in Colombia is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and work with AI and product teams to operationalize model-enabled use cases.

You will contribute to architecture, ensure data quality and security, and deliver reliable, cost-efficient solutions across development and production environments.