Senior Data Engineer

VLink Inc; Jakarta Pusat; On-site; IDR 400,000,000 - 700,000,000; Full time

Job summary

VLink Inc in Jakarta is seeking a seasoned Data Engineer to analyze, build, and optimize data pipelines. You will transform unstructured data into structured formats and manage end-to-end ETL/CDC workflows across cloud and on-premise environments.

The role requires strong Python and SQL skills, experience with ETL tools, Big Data tech, and data visualization with Power BI. Collaboration with cross-functional teams to resolve pipeline issues is essential.

Qualifications

• At least 5-8 years of professional work experience, with a heavy specialization in Data Engineering. Hands-on experience with SQL, focusing on performance tuning, complex joins, and data granularity.
• Strong proficiency in Python, specifically the ability to read, refactor, and maintain existing codebases.
• Proven expertise in ETL tools (Kettle, Pentaho, Informatica) and modern data transformation frameworks like dbt (data build tool).
• Knowledge of Big Data tools such as Hive, Impala, and cloud-native solutions like BigQuery and Azure Data Factory.
• Familiarity with REST APIs, basic programming principles, and data visualization tools like Power BI.
• Proactive mindset with an eagerness to learn and adapt to new emerging technologies.

Responsibilities

• Analyze, maintain, and optimize existing Python scripts to ensure seamless data pipeline automation and system reliability.
• Design and implement scalable processes to transform unstructured or semi-structured data like JSON, XML, and logs into structured tabular formats.
• Develop and manage end-to-end ETL and CDC workflows using tools such as SSIS, Talend, Informatica, or Azure Data Factory.
• Implement event-based streaming and real-time data processing using Debezium, Kafka, Flink, and Spark.
• Manage and query diverse database environments, including PostgreSQL, Oracle, SQL Server, NoSQL (MongoDB), and GraphDB (Gsql/TG).
• Oversee Data Warehouse architecture and manage job scheduling and orchestration across cloud (GCP/BigQuery/Azure) and on-premise systems.
• Collaborate with cross-functional teams to translate complex data requirements into technical solutions while troubleshooting and resolving pipeline issues.

Skills

Python

SQL

REST APIs

Tools

Kettle

Pentaho

Informatica

dbt

Hive

Impala

BigQuery

Azure Data Factory

Power BI

Job description

• Analyze, maintain, and optimize existing Python scripts to ensure seamless data pipeline automation and system reliability.
• Design and implement scalable processes to transform unstructured or semi-structured data like JSON, XML, and logs into structured tabular formats.
• Develop and manage end-to-end ETL and CDC workflows using tools such as SSIS, Talend, Informatica, or Azure Data Factory.
• Implement event-based streaming and real-time data processing using Debezium, Kafka, Flink, and Spark.
• Manage and query diverse database environments, including PostgreSQL, Oracle, SQL Server, NoSQL (MongoDB), and GraphDB (Gsql/TG).
• Oversee Data Warehouse architecture and manage job scheduling and orchestration across cloud (GCP/BigQuery/Azure) and on-premise systems.
• Collaborate with cross-functional teams to translate complex data requirements into technical solutions while troubleshooting and resolving pipeline issues.

Qualifications:

• At least 5-8 years of professional work experience, with a heavy specialization in Data Engineering. Hands-on experience with SQL, focusing on performance tuning, complex joins, and data granularity.
• Strong proficiency in Python, specifically the ability to read, refactor, and maintain existing codebases.
• Proven expertise in ETL tools (Kettle, Pentaho, Informatica) and modern data transformation frameworks like dbt (data build tool).
• Knowledge of Big Data tools such as Hive, Impala, and cloud-native solutions like BigQuery and Azure Data Factory.
• Familiarity with REST APIs, basic programming principles, and data visualization tools like Power BI.
• Proactive mindset with an eagerness to learn and adapt to new emerging technologies.