Cloud Data Pipeline Engineer | Scale & Automate ETL

Viventis Search Asia; Quezon City; Presencial; PHP 900.000 - 1.500.000; Jornada completa

Descripción de la vacante

Viventis Search Asia in the Philippines is seeking a Data Engineer to design and manage data pipelines, data lakes, and warehouses. The role focuses on scalable architectures, ETL/ELT processes, and data quality to support business analysis and decision-making.

You will collaborate with the data team to optimize performance, implement monitoring, and automate cloud-based workflows across Azure and other platforms. Strong Python/SQL skills and experience with Databricks are required.

Formación

• Degree in Computer Engineering / Data Science / Statistics / Physics or any IT-related field.
• Knowledge in Agile methodology (e.g. Scrum & Kanban)
• Experience with cloud computing platforms (Azure)
• Proficiency in coding languages: Python (Apache Spark), SQL, DAX
• Experience with file types: parquet, sql, csv, xlsx, json, txt
• Experience with systems/softwares/platforms: Github, Databricks, AWS, PowerBI, Linux
• ETL/ELT, Integration, API, Statistics, Code/Performance Optimization, Data Wrangling, Data Pipelines, Data Modeling, Data Quality, Data Governance

Responsabilidades

• Design, build, and maintain scalable data pipelines that support data collection, transformation, and integration from various sources.
• Maintain databases, data warehouses, data lake ensuring data integrity, scalability, and reliability.
• Implement efficient ETL/ELT (Extract, Transform, Load) processes to automate data collection, cleaning, and transformation tasks.
• Integrate data from various internal and external sources, including APIs, cloud storage, third-party systems, and databases.
• Optimize data architectures for performance, scalability, and cost efficiency. Ensure fast and reliable data retrieval.
• Work closely with the data team to understand data needs and deliver reliable, clean, and accessible data solutions.
• Implement data validation and monitoring processes to ensure data accuracy and integrity. Identify and troubleshoot data issues and bottlenecks.
• Manage and optimize cloud-based infrastructure (e.g., AWS, Azure) to support data storage, processing, and retrieval.
• Automate repetitive tasks and processes using scripting languages (e.g., Python and SQL) and workflows.
• Document data architectures, pipelines, and workflows that will be understood by the Information Technology (IT) department. Provide technical support and troubleshooting to the team.

Conocimientos

Python (Apache Spark)

SQL

DAX

Azure cloud

Agile (Scrum & Kanban)

Data modeling/ETL

Educación

Degree in Computer Engineering / Data Science / Statistics / Physics or IT

Herramientas

Github

Databricks

AWS

PowerBI

Linux

Descripción del empleo

Viventis Search Asia in the Philippines is seeking a Data Engineer to design and manage data pipelines, data lakes, and warehouses. The role focuses on scalable architectures, ETL/ELT processes, and data quality to support business analysis and decision-making.

You will collaborate with the data team to optimize performance, implement monitoring, and automate cloud-based workflows across Azure and other platforms. Strong Python/SQL skills and experience with Databricks are required.