Senior Kafka Data Engineer: Real-time Pipelines on Azure

Accenture; Kota Semarang; Vor Ort; IDR 100.440.000 - 245.520.000; Vollzeit

Zusammenfassung

Accenture is hiring a Data Engineer to work across workstreams, building and optimizing data pipelines, dashboards, and data quality processes. You will profile data, translate business requirements into technical specs, and enable real-time and batch ingestion using Spark, Azure, and Databricks.

Strong English communication is required, with consulting experience a plus. Join a global team delivering data-driven solutions across large-scale applications, leveraging Power BI for visualization

Qualifikationen

• Bachelor’s degree in CS/IT or related field.
• Minimum 2 years’ experience in Data Engineering (new grads welcome for some openings).
• Experience with Python, SQL, Spark, Azure, Databricks.
• Data visualization with Power BI or equivalent.
• Experience in client-facing/consulting is a plus.

Aufgaben

• Support data requirements including reports and dashboards across workstreams.
• Analyze and profile data to identify patterns and discrepancies.
• Design and develop end-to-end data pipelines: ingestion, transformation, processing, surfacing.
• Automate data pipelines using Azure stack, Databricks, Data Factory.
• Translate business requirements into technical specifications for development.
• Analyze source data and perform batch and real-time data ingestion (files, APIs, Kafka, Spark Streaming).
• Develop ETL using Spark and enable data exports, APIs, or visualizations.

Kenntnisse

Team player

Analytical skills

Problem-solving

English communication

Ausbildung

Bachelor’s degree in Computer Science/Computer Engineering/IT or related fields

Tools

Python

SQL

Spark

Databricks

Azure

Power BI

API

Jobbeschreibung

Accenture is hiring a Data Engineer to work across workstreams, building and optimizing data pipelines, dashboards, and data quality processes. You will profile data, translate business requirements into technical specs, and enable real-time and batch ingestion using Spark, Azure, and Databricks.

Strong English communication is required, with consulting experience a plus. Join a global team delivering data-driven solutions across large-scale applications, leveraging Power BI for visualization