Data Engineer: Scale ETL Pipelines & Data Lakes

Particle41; Colombia; A distancia; COP 60.000.000 - 100.000.000; Jornada completa

Descripción de la vacante

Particle41 is seeking a talented Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure scalable and efficient data delivery.

Responsibilities include developing ETL pipelines, data storage solutions, data integration, and data quality assurance. Familiarity with cloud platforms and agile collaboration is expected.

Formación

• Bachelor's degree in Computer Science, Engineering, or related field.
• Minimum 3 years of Data Engineer experience.
• Proficiency in Python and SQL.

Responsabilidades

• Design, build, and maintain scalable ETL pipelines.
• Develop data storage solutions (data lakes/warehouses) for efficient data retrieval.
• Integrate structured and unstructured data from various systems to create unified analytical views.
• Ensure data accuracy and quality through validation and transformation processes.
• Maintain documentation for data processes, tools, and systems.

Conocimientos

Python

SQL

NoSQL (MongoDB)

Data pipelines

ETL

Cloud platforms

Linux

Shell scripting

Data warehousing

Spark / PySpark

Educación

Bachelor's degree in Computer Science or related

Herramientas

Flask

API frameworks

Databricks

Pandas

Spark

OpenCV

Redis

ELK stack

Git

Descripción del empleo

Particle41 is seeking a talented Data Engineer to design, build, and maintain robust data pipelines and infrastructure. You will work on end-to-end data solutions, collaborating with cross-functional teams to ensure scalable and efficient data delivery.

Responsibilities include developing ETL pipelines, data storage solutions, data integration, and data quality assurance. Familiarity with cloud platforms and agile collaboration is expected.