Data Engineer

Metova; Colombia; Presencial; COP 30.000 - 45.000; Jornada completa

Descripción de la vacante

Metova is looking for a Data Engineer in Colombia. The role involves designing and developing ETL/ELT pipelines and ensuring data quality. Candidates should have a Bachelor's in Computer Systems Engineering or related fields and 5-8 years of experience.

Required skills include proficiency in Java, Scala, Python, and SQL, as well as experience with frameworks like Spark and tools such as Airflow. Intermediate-advanced English proficiency is also necessary.

Formación

• 5 to 8 years of experience in similar roles.
• Intermediate-Advanced English proficiency.

Responsabilidades

• Participate in cross-functional meetings to define project objectives.
• Analyze and prioritize business requirements related to data.
• Design and develop data extraction, transformation, and loading pipelines.
• Validate the integrity and security of data engineering processes.

Conocimientos

Java

Scala

Python

SQL

Spark

Flink

PostgreSQL

Cassandra

MongoDB

Airflow

Airbyte

Stitch

Git

Educación

Bachelor's degree in Computer Systems Engineering, Computer Science, or related field

Specialization in Data Engineering

Descripción del empleo

Responsibilities

• Participate in cross-functional meetings to define project objectives and scope
• Analyze and prioritize business requirements related to data
• Design and develop data extraction, transformation, and loading pipelines (ETL/ELT)
• Develop applications for extracting data from various sources and formats (JSON, XML, PDF, etc.)
• Write clean, efficient, and scalable code, adapting to new technologies as needed
• Implement data quality methodologies throughout ingestion and transformation processes
• Optimize services, queries, and processes to reduce operational costs and improve performance
• Validate the functionality, integrity, and security of data engineering processes

Requirements

Bachelor's degree in Computer Systems Engineering, Computer Science, or related field.

Specialization in Data Engineering (preferred).

5 to 8 years of experience in similar roles.

Intermediate-Advanced English proficiency.

Technical Skills

• Programming languages: Java, Scala, Python, and SQL
• Experience with data processing frameworks (Spark, Flink, etc.)
• Experience with SQL and NoSQL databases (PostgreSQL, Cassandra, MongoDB, etc.)
• Experience with orchestration and ETL tools (Airflow, Airbyte, Stitch, etc.)
• Experience implementing data quality methodologies throughout ingestion and transformation processes
• Design and architecture of Data Lakes, Data Warehouses, and Lakehouse solutions
• Data modeling (star schema, snowflake schema, OBT)
• Development and consumption of REST APIs
• Experience with Git

Nice to Have

• Experience with web scraping projects
• Knowledge of additional languages such as Go or JavaScript
• Experience with streaming and messaging systems (Kafka, RabbitMQ)
• Background in data science projects