Remote Data Engineer: Spark, EMR & AI

Lifted, an Upwork Company™; Bogotá; Presencial; COP 221.758.000 - 348.476.000; Jornada completa

Descripción de la vacante

Lifted, an Upwork Company, is seeking an experienced Software/Data Engineer for a remote contract role focused on scalable data processing using Spark, cloud platforms, and AI-enabled workflows. The position requires LATAM residency (excluding Mexico), and US Central Time coverage with about 40 hours weekly.

The contract end date is March 31, 2027. Responsibilities include building data pipelines, transforming data, integrating ML workflows, and ensuring production reliability and data quality

Formación

• 4+ years of software or data engineering experience.
• Strong experience with Spark and distributed data processing.
• Experience with Amazon EMR or similar cloud-based platforms.
• Proficiency in Java, Python, or a related language.
• Exposure to AI or machine learning workflows and data prep.
• Strong understanding of scalable data architecture and performance optimization.
• Strong debugging and collaboration skills.
• Ability to bridge software and data engineering responsibilities.

Responsabilidades

• Design and develop scalable data processing solutions using Spark and cloud platforms.
• Build and maintain batch and distributed data pipelines.
• Develop components for data transformation and AI workflow integration.
• Collaborate with engineering, AI, and product teams to operationalize data-driven use cases.
• Optimize data pipeline performance, cost, scalability, and reliability.
• Troubleshoot data and application issues across environments.
• Contribute to architecture discussions and engineering standards.
• Ensure data quality, governance, and security.

Conocimientos

Spark

EMR

Java/Python

ML workflows

Data architecture

Debugging

Collaboration

Herramientas

AWS EMR

Descripción del empleo

Lifted, an Upwork Company, is seeking an experienced Software/Data Engineer for a remote contract role focused on scalable data processing using Spark, cloud platforms, and AI-enabled workflows. The position requires LATAM residency (excluding Mexico), and US Central Time coverage with about 40 hours weekly.

The contract end date is March 31, 2027. Responsibilities include building data pipelines, transforming data, integrating ML workflows, and ensuring production reliability and data quality