Senior Data Engineer: Spark & AI Pipelines (Remote)

AgileEngine, LLC.; Bogotá; Presencial; COP 378.310.000 - 567.465.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Growth opportunities

Remote-friendly culture

Competitive compensation

Annual learning budget

Flexible hours

Global collaboration

Descripción de la vacante

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

Strong architecture sense and comfort in data-intensive environments are essential as you optimize performance, ensure data quality, and contribute to engineering standards for a global remote team.

Formación

• 4+ years of software or data engineering experience.
• Strong experience with Spark and distributed data processing.
• Experience with Amazon EMR or similar cloud-based platforms.
• Proficiency in Java, Python, or related languages.
• Exposure to AI/ML workflows, model integration, or data preparation for intelligent systems.
• Strong understanding of scalable data architecture and performance optimization.
• Strong debugging and collaboration skills.
• Able to bridge software and data engineering responsibilities.
• Strong execution with practical architecture sense.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and EMR.
• Build and maintain batch and distributed data pipelines.
• Collaborate with engineering, AI, and product teams to operationalize data-driven and model-enabled use cases.
• Develop software components for data transformation, feature preparation, and AI workflow integration.
• Optimize pipeline performance, cost efficiency, and production reliability.
• Troubleshoot data and application issues across dev and prod environments.
• Contribute to architecture discussions, documentation, and engineering standards.
• Ensure solutions align with data quality, governance, and security expectations.

Conocimientos

4+ years exp

Spark experience

Distributed data

Java

Python

AI workflows

Model integration

Data architecture

Performance optimization

Debugging

Cross-functional

Data engineering

Herramientas

Kafka

Airflow

AWS

EMR

Descripción del empleo

AgileEngine is seeking a Senior Software Engineer to design scalable data processing systems using Spark and EMR. You will build batch and distributed pipelines and collaborate with AI and product teams to operationalize model-enabled use cases.

Strong architecture sense and comfort in data-intensive environments are essential as you optimize performance, ensure data quality, and contribute to engineering standards for a global remote team.