Senior Data Engineer – ETL Pipelines & Data Lakes

Metova; México; Presencial; MXN 606.796 - 866.851; Jornada completa

Descripción de la vacante

A leading technology company in Mexico is seeking a Data Engineer responsible for designing, developing, and optimizing data processing solutions. The role involves participating in cross-functional meetings, analyzing business requirements, and developing ETL pipelines. Candidates should have a Bachelor's degree, 5-8 years of experience, and proficiency in Java, Scala, Python, and SQL. This position is crucial for ensuring quality, scalability, and security in software products.

Formación

• 5 to 8 years of experience in similar roles.
• Hands-on experience with batch and streaming data processing.
• Intermediate-Advanced English proficiency.

Responsabilidades

• Participate in cross-functional meetings to define project objectives and scope.
• Analyze and prioritize business requirements related to data.
• Design and develop data extraction, transformation, and loading pipelines (ETL/ELT).
• Develop applications for extracting data from various sources and formats.
• Write clean, efficient, and scalable code, adapting to new technologies as needed.
• Implement data quality methodologies throughout ingestion and transformation processes.
• Optimize services, queries, and processes to reduce operational costs and improve performance.
• Validate the functionality, integrity, and security of data engineering processes.

Conocimientos

Java

Scala

Python

SQL

Spark

Flink

PostgreSQL

Cassandra

MongoDB

Airflow

Airbyte

Stitch

Git

Educación

Bachelor's degree in Computer Systems Engineering, Computer Science, or related field

Specialization in Data Engineering

Descripción del empleo

A leading technology company in Mexico is seeking a Data Engineer responsible for designing, developing, and optimizing data processing solutions. The role involves participating in cross-functional meetings, analyzing business requirements, and developing ETL pipelines. Candidates should have a Bachelor's degree, 5-8 years of experience, and proficiency in Java, Scala, Python, and SQL. This position is crucial for ensuring quality, scalability, and security in software products.