Kafka Data Engineer: Real-Time Pipelines & Azure

7500 PT Accenture Company; Kota Semarang; On-site; IDR 240,000,000 - 420,000,000; Full time

Job summary

Accenture seeks a Data Engineer to join our Semarang delivery hub. You will work across workstreams to support data requirements, design and develop end-to-end data pipelines, and implement data ingestion and processing at scale using Spark, Databricks, and Azure.

The role requires Python, SQL, and cloud data engineering skills, with experience in BI tools like Power BI or Tableau, and the ability to translate business needs into technical specifications while collaborating with a client-facing

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, IT, or related field.
• Experience in Data Engineering; fresh graduates welcome for some openings.
• Strong Python, SQL, Spark and cloud data engineering skills.
• Knowledge of Databricks, Azure, API and data visualization basics.

Responsibilities

• Work across workstreams to support data requirements including reports and dashboards.
• Analyze and perform data profiling to understand data patterns and discrepancies.
• Design and develop end-to-end data pipelines: ingestion, transformation and surfacing of data.
• Develop data pipeline automation using Azure technologies stack and Databricks.
• Translate business requirements into technical requirements for delivery teams.
• Implement data ingestion in batch and real-time patterns via file transfer, API, Kafka, Spark Streaming.

Skills

Python

SQL

Spark

Databricks

Azure

Power BI

ETL

APIs

Education

Bachelor’s degree in CS/CE/IT

Tools

Azure Data Factory

Kafka

Spark Streaming

Job description

Accenture seeks a Data Engineer to join our Semarang delivery hub. You will work across workstreams to support data requirements, design and develop end-to-end data pipelines, and implement data ingestion and processing at scale using Spark, Databricks, and Azure.

The role requires Python, SQL, and cloud data engineering skills, with experience in BI tools like Power BI or Tableau, and the ability to translate business needs into technical specifications while collaborating with a client-facing