Data Engineer

Viventis Search Asia; Quezon City; On-site; PHP 900,000 - 1,500,000; Full time

Job summary

Viventis Search Asia in the Philippines is seeking a Data Engineer to design and manage data pipelines, data lakes, and warehouses. The role focuses on scalable architectures, ETL/ELT processes, and data quality to support business analysis and decision-making.

You will collaborate with the data team to optimize performance, implement monitoring, and automate cloud-based workflows across Azure and other platforms. Strong Python/SQL skills and experience with Databricks are required.

Qualifications

• Degree in Computer Engineering / Data Science / Statistics / Physics or any IT-related field.
• Knowledge in Agile methodology (e.g. Scrum & Kanban)
• Experience with cloud computing platforms (Azure)
• Proficiency in coding languages: Python (Apache Spark), SQL, DAX
• Experience with file types: parquet, sql, csv, xlsx, json, txt
• Experience with systems/softwares/platforms: Github, Databricks, AWS, PowerBI, Linux
• ETL/ELT, Integration, API, Statistics, Code/Performance Optimization, Data Wrangling, Data Pipelines, Data Modeling, Data Quality, Data Governance

Responsibilities

• Design, build, and maintain scalable data pipelines that support data collection, transformation, and integration from various sources.
• Maintain databases, data warehouses, data lake ensuring data integrity, scalability, and reliability.
• Implement efficient ETL/ELT (Extract, Transform, Load) processes to automate data collection, cleaning, and transformation tasks.
• Integrate data from various internal and external sources, including APIs, cloud storage, third-party systems, and databases.
• Optimize data architectures for performance, scalability, and cost efficiency. Ensure fast and reliable data retrieval.
• Work closely with the data team to understand data needs and deliver reliable, clean, and accessible data solutions.
• Implement data validation and monitoring processes to ensure data accuracy and integrity. Identify and troubleshoot data issues and bottlenecks.
• Manage and optimize cloud-based infrastructure (e.g., AWS, Azure) to support data storage, processing, and retrieval.
• Automate repetitive tasks and processes using scripting languages (e.g., Python and SQL) and workflows.
• Document data architectures, pipelines, and workflows that will be understood by the Information Technology (IT) department. Provide technical support and troubleshooting to the team.

Skills

Python (Apache Spark)

SQL

DAX

Azure cloud

Agile (Scrum & Kanban)

Data modeling/ETL

Education

Degree in Computer Engineering / Data Science / Statistics / Physics or IT

Tools

Github

Databricks

AWS

PowerBI

Linux

Job description

About the role

The Data Engineer will be responsible for designing, developing, and managing data pipelines and architectures. They will ensure that data flows seamlessly from multiple sources into databases, data lakes, or warehouses and is processed in a way that supports business analysis and decision-making. The ideal candidate will have strong software engineering skills, experience with data processing frameworks, and the ability to optimize and scale large data systems.

Key responsibilities

• Design, build, and maintain scalable data pipelines that support data collection, transformation, and integration from various sources.

• Maintain databases, data warehouses, data lake ensuring data integrity, scalability, and reliability.

• Implement efficient ETL/ELT (Extract, Transform, Load) processes to automate data collection, cleaning, and transformation tasks.

• Integrate data from various internal and external sources, including APIs, cloud storage, third-party systems, and databases.

• Optimize data architectures for performance, scalability, and cost efficiency. Ensure fast and reliable data retrieval.

• Work closely with the data team to understand data needs and deliver reliable, clean, and accessible data solutions.

• Implement data validation and monitoring processes to ensure data accuracy and integrity. Identify and troubleshoot data issues and bottlenecks.

• Manage and optimize cloud-based infrastructure (e.g., AWS, Azure) to support data storage, processing, and retrieval.

• Automate repetitive tasks and processes using scripting languages (e.g., Python and SQL) and workflows.

• Document data architectures, pipelines, and workflows that will be understood by the Information Technology (IT) department. Provide technical support and troubleshooting to the team.

About you

• Degree in Computer Engineering / Data Science / Statistics / Physics or any other related field in IT.

• Knowledge in Agile methodology (e.g. Scrum & Kanban)

• Experienced in using cloud computing platforms (Azure)

• Proficiency in coding languages: Python (Apache Spark), SQL, DAX

• Experience with file types: parquet, sql, csv, xlsx, json, txt

• Experience with systems/softwares/platforms: Github, Databricks, AWS, PowerBI, Linux

• Other qualifications: ETL/ELT, Integration, API, Statistics, Code/Performance Optimization, Data Wrangling, Data Pipelines, Data Modeling, Data Quality, Data Governance