Senior Data Engineer - Pipelines & Elastic Hierarchy

Softgic S.; Colombia; Híbrido; COP 142.734.798 - 214.102.198; Jornada completa

Descripción de la vacante

Softgic S. is looking for a Senior Data Engineer to design and maintain scalable data systems supporting analytics and machine learning. The role involves working in a hybrid SaaS and on-premise environment, with a focus on optimizing data flow through the Elastic Hierarchy framework.

The ideal candidate will have a Bachelor's or Master's degree in a related field and strong Python development skills, along with experience in the AWS ecosystem and tools like Snowflake and MongoDB.

Formación

• Strong proficiency in Python development.
• Experience with the AWS data ecosystem, including services such as S3, Glue, Lambda, EMR, EC2, Redshift, and RDS.
• Hands-on experience with Snowflake, MongoDB, and PostgreSQL.

Responsabilidades

• Design, develop, and maintain scalable ETL/ELT data pipelines using Python.
• Process and integrate data from multiple formats and sources, including JSON, CSV, and XML.
• Build and manage data transformations and orchestration workflows.

Conocimientos

Python development

AWS data ecosystem

Snowflake

MongoDB

PostgreSQL

DBT

Data orchestration tools

Educación

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

Herramientas

AWS services (S3, Glue, Lambda, EMR, EC2, Redshift, RDS)

Airflow

Prefect

Dagster

Descripción del empleo

Softgic S. is looking for a Senior Data Engineer to design and maintain scalable data systems supporting analytics and machine learning. The role involves working in a hybrid SaaS and on-premise environment, with a focus on optimizing data flow through the Elastic Hierarchy framework.

The ideal candidate will have a Bachelor's or Master's degree in a related field and strong Python development skills, along with experience in the AWS ecosystem and tools like Snowflake and MongoDB.