Data Engineer (Azure)

VLink Inc

Jakarta Pusat

On-site

IDR 400,000,000 - 700,000,000

Full time

13 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

VLink Inc is seeking a seasoned Data Engineer to optimize data pipelines and ensure reliable automation of ETL processes. The role focuses on transforming unstructured data into structured formats, designing scalable ETL/CD workflows, and collaborating with cross-functional teams to translate complex data needs into robust solutions.

You will work with cloud and on-premise environments (GCP/Azure), manage databases (PostgreSQL, NoSQL), and implement real-time processing using Debezium, Kafka,

Qualifications

  • 5-8 years of Data Engineering experience with emphasis on pipelines and data workflows.
  • Strong Python proficiency including reading, refactoring, and maintaining codebases.
  • Expertise with ETL tools (Kettle, Pentaho, Informatica) and modern transformations (dbt).
  • Knowledge of Big Data tools (Hive, Impala) and cloud-native solutions (BigQuery, Azure Data Factory).
  • Experience with REST APIs and data visualization (Power BI).
  • Proactive learner, able to adapt to emerging technologies.

Responsibilities

  • Analyze, maintain, and optimize existing Python scripts to ensure seamless data pipeline automation and system reliability.
  • Design and implement scalable processes to transform unstructured or semi-structured data like JSON, XML, and logs into structured tabular formats.
  • Develop and manage end-to-end ETL and CDC workflows using tools such as SSIS, Talend, Informatica, or Azure Data Factory.
  • Implement event-based streaming and real-time data processing using Debezium, Kafka, Flink, and Spark.
  • Manage and query diverse database environments, including PostgreSQL, Oracle, SQL Server, NoSQL (MongoDB), and GraphDB (Gsql/TG).
  • Oversee Data Warehouse architecture and manage job scheduling and orchestration across cloud (GCP/BigQuery/Azure) and on-premise systems.
  • Collaborate with cross-functional teams to translate complex data requirements into technical solutions while troubleshooting and resolving pipeline issues.

Skills

Python
SQL
ETL
Data modeling
Data warehousing
REST APIs
Power BI

Tools

Kettle
Pentaho
Informatica
dbt
Hive
Impala
BigQuery
Azure Data Factory
Kafka
Debezium
Flink
Spark

Job description

  • Analyze, maintain, and optimize existing Python scripts to ensure seamless data pipeline automation and system reliability.
  • Design and implement scalable processes to transform unstructured or semi-structured data like JSON, XML, and logs into structured tabular formats.
  • Develop and manage end-to-end ETL and CDC workflows using tools such as SSIS, Talend, Informatica, or Azure Data Factory.
  • Implement event-based streaming and real-time data processing using Debezium, Kafka, Flink, and Spark.
  • Manage and query diverse database environments, including PostgreSQL, Oracle, SQL Server, NoSQL (MongoDB), and GraphDB (Gsql/TG).
  • Oversee Data Warehouse architecture and manage job scheduling and orchestration across cloud (GCP/BigQuery/Azure) and on-premise systems.
  • Collaborate with cross-functional teams to translate complex data requirements into technical solutions while troubleshooting and resolving pipeline issues.
Qualifications
  • At least 5-8 years of professional work experience, with a heavy specialization in Data Engineering. Hands-on experience with SQL, focusing on performance tuning, complex joins, and data granularity.
  • Strong proficiency in Python, specifically the ability to read, refactor, and maintain existing codebases.
  • Proven expertise in ETL tools (Kettle, Pentaho, Informatica) and modern data transformation frameworks like dbt (data build tool).
  • Knowledge of Big Data tools such as Hive, Impala, and cloud-native solutions like BigQuery and Azure Data Factory.
  • Familiarity with REST APIs, basic programming principles, and data visualization tools like Power BI.
  • Proactive mindset with an eagerness to learn and adapt to new emerging technologies.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

PT. Pasifik Cipta Solusi • Tangerang Selatan

On-site
IDR 279,000,000 - 446,400,000
Data Engineer: ETL & Cloud Data Platform Architect
Data Engineer: ETL & Cloud Data Platform Architect

Luminare Consulting • Jakarta Selatan

On-site
IDR 20,000,000 - 30,000,000
Data Engineer | Remote
Data Engineer | Remote

Crossing Hurdles • Indonesia

On-site
IDR 180,000,000 - 320,000,000
Data Engineer (IT Consulting)
Data Engineer (IT Consulting)

Luminare Consulting • Jakarta Selatan

On-site
IDR 20,000,000 - 30,000,000
Data Engineer
Data Engineer

Esha Parama Inc. • Daerah Khusus Ibukota Jakarta

On-site
IDR 100,440,000 - 167,400,000
Data Engineer
Data Engineer

Celerates • Jakarta Pusat

On-site
IDR 240,000,000 - 380,000,000
Data Engineer – Cloud ETL & Big Data
Data Engineer – Cloud ETL & Big Data

Arbeit Infotech • Jakarta Selatan

On-site
IDR 400,000,000 - 800,000,000
Data Engineer
Data Engineer

Super Bank Indonesia • Jakarta Pusat

On-site
IDR 250,000,000 - 420,000,000
Data Engineer & Analytics
Data Engineer & Analytics

Kredivo Group • Daerah Khusus Ibukota Jakarta

On-site
IDR 401,270,690 - 601,906,035
DATA ENGINEER SUPERVISOR
DATA ENGINEER SUPERVISOR

International Beauty Products Ltd. • Indonesia

On-site
IDR 300,000,000 - 550,000,000