Senior Data Engineer: Spark, EMR & AI Pipelines

AgileEngine; Bogotá; Presencial; COP 120.000.000 - 180.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work

Learning & growth stipend

Competitive compensation

Descripción de la vacante

AgileEngine in Bogotá, Colombia is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines, collaborating with AI and product teams to operationalize model-enabled use cases.

Ideal candidates have 4+ years in software or data engineering, strong Spark experience, proficiency in Java or Python, and familiarity with cloud platforms like AWS EMR. English at an upper-intermediate level is expected.

Formación

• 4+ years of software or data engineering experience.
• Strong experience with Spark and distributed data processing.
• Experience with Amazon EMR or similar cloud-based data processing platforms.
• Proficiency in Java, Python, or related programming languages.
• Exposure to AI or machine learning workflows, model integration, or data preparation for intelligent systems.
• Strong understanding of scalable data architecture and performance optimization.
• Strong debugging and collaboration skills.
• Comfortable delivering in evolving, data-intensive environments.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with engineering, AI, and product teams to operationalize data-driven and model-enabled use cases.
• Develop software components for data transformation, feature preparation, and AI workflow integration.
• Optimize pipeline performance, cost efficiency, and production reliability.
• Troubleshoot data and application issues across development and production environments.
• Contribute to architecture discussions, documentation, and engineering standards.
• Ensure solutions align with data quality, governance, and security expectations.

Conocimientos

Spark

Python

Java

Data engineering

Distributed processing

Upper-intermediate English

Cloud/AWS

Debugging

Herramientas

EMR

Kafka

Airflow

Descripción del empleo

AgileEngine in Bogotá, Colombia is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines, collaborating with AI and product teams to operationalize model-enabled use cases.

Ideal candidates have 4+ years in software or data engineering, strong Spark experience, proficiency in Java or Python, and familiarity with cloud platforms like AWS EMR. English at an upper-intermediate level is expected.