Azure Data Engineer: ETL & Real-Time Streaming Specialist

VLink Inc

Jakarta Pusat

On-site

IDR 400,000,000 - 700,000,000

Full time

14 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

VLink Inc is seeking a seasoned Data Engineer to optimize data pipelines and ensure reliable automation of ETL processes. The role focuses on transforming unstructured data into structured formats, designing scalable ETL/CD workflows, and collaborating with cross-functional teams to translate complex data needs into robust solutions.

You will work with cloud and on-premise environments (GCP/Azure), manage databases (PostgreSQL, NoSQL), and implement real-time processing using Debezium, Kafka,

Qualifications

  • 5-8 years of Data Engineering experience with emphasis on pipelines and data workflows.
  • Strong Python proficiency including reading, refactoring, and maintaining codebases.
  • Expertise with ETL tools (Kettle, Pentaho, Informatica) and modern transformations (dbt).
  • Knowledge of Big Data tools (Hive, Impala) and cloud-native solutions (BigQuery, Azure Data Factory).
  • Experience with REST APIs and data visualization (Power BI).
  • Proactive learner, able to adapt to emerging technologies.

Responsibilities

  • Analyze, maintain, and optimize existing Python scripts to ensure seamless data pipeline automation and system reliability.
  • Design and implement scalable processes to transform unstructured or semi-structured data like JSON, XML, and logs into structured tabular formats.
  • Develop and manage end-to-end ETL and CDC workflows using tools such as SSIS, Talend, Informatica, or Azure Data Factory.
  • Implement event-based streaming and real-time data processing using Debezium, Kafka, Flink, and Spark.
  • Manage and query diverse database environments, including PostgreSQL, Oracle, SQL Server, NoSQL (MongoDB), and GraphDB (Gsql/TG).
  • Oversee Data Warehouse architecture and manage job scheduling and orchestration across cloud (GCP/BigQuery/Azure) and on-premise systems.
  • Collaborate with cross-functional teams to translate complex data requirements into technical solutions while troubleshooting and resolving pipeline issues.

Skills

Python
SQL
ETL
Data modeling
Data warehousing
REST APIs
Power BI

Tools

Kettle
Pentaho
Informatica
dbt
Hive
Impala
BigQuery
Azure Data Factory
Kafka
Debezium
Flink
Spark

Job description

VLink Inc is seeking a seasoned Data Engineer to optimize data pipelines and ensure reliable automation of ETL processes. The role focuses on transforming unstructured data into structured formats, designing scalable ETL/CD workflows, and collaborating with cross-functional teams to translate complex data needs into robust solutions.

You will work with cloud and on-premise environments (GCP/Azure), manage databases (PostgreSQL, NoSQL), and implement real-time processing using Debezium, Kafka,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer (Azure)
Data Engineer (Azure)

VLink Inc • Jakarta Pusat

On-site
IDR 400,000,000 - 700,000,000
Cloud Platform Engineer: Automation, Kubernetes & IaC
Cloud Platform Engineer: Automation, Kubernetes & IaC

VLink Inc • Jakarta Pusat

On-site
IDR 300,000,000 - 600,000,000
Data Engineer
Data Engineer

PT. Pasifik Cipta Solusi • Tangerang Selatan

On-site
IDR 279,000,000 - 446,400,000
Kafka Data Engineer: Real-Time Pipelines & Azure
Kafka Data Engineer: Real-Time Pipelines & Azure

7500 PT Accenture Company • Kota Semarang

On-site
IDR 240,000,000 - 420,000,000
Data Engineer – Cloud ETL & Big Data
Data Engineer – Cloud ETL & Big Data

Arbeit Infotech • Jakarta Selatan

On-site
IDR 400,000,000 - 800,000,000
Data Engineer: ETL & Cloud Data Platform Architect
Data Engineer: ETL & Cloud Data Platform Architect

Luminare Consulting • Jakarta Selatan

On-site
IDR 20,000,000 - 30,000,000
Data Engineer: Real-Time Pipelines & Data Marts
Data Engineer: Real-Time Pipelines & Data Marts

PT Sea Group • Jakarta Pusat

On-site
IDR 167,400,000 - 334,800,000
Data Platform Engineer: Real-Time Pipelines & Insights
Data Platform Engineer: Real-Time Pipelines & Insights

Bukuwarung • Indonesia

Remote
IDR 180,000,000 - 300,000,000
Data Engineer: Real-Time Pipelines & Data Marts
Data Engineer: Real-Time Pipelines & Data Marts

SEA Singapore • Jakarta Pusat

On-site
IDR 360,000,000 - 600,000,000
Senior Data Engineer - Real-Time Pipelines & Lakehouse
Senior Data Engineer - Real-Time Pipelines & Lakehouse

Amk Technology • Jakarta Pusat

On-site
IDR 384,000,000 - 624,000,000