Senior Apache Kafka Data Engineer

Accenture; Kota Semarang; Sur place; IDR 100 440 000 - 245 520 000; Plein temps

Résumé du poste

Accenture is hiring a Data Engineer to work across workstreams, building and optimizing data pipelines, dashboards, and data quality processes. You will profile data, translate business requirements into technical specs, and enable real-time and batch ingestion using Spark, Azure, and Databricks.

Strong English communication is required, with consulting experience a plus. Join a global team delivering data-driven solutions across large-scale applications, leveraging Power BI for visualization

Qualifications

• Bachelor’s degree in CS/IT or related field.
• Minimum 2 years’ experience in Data Engineering (new grads welcome for some openings).
• Experience with Python, SQL, Spark, Azure, Databricks.
• Data visualization with Power BI or equivalent.
• Experience in client-facing/consulting is a plus.

Responsabilités

• Support data requirements including reports and dashboards across workstreams.
• Analyze and profile data to identify patterns and discrepancies.
• Design and develop end-to-end data pipelines: ingestion, transformation, processing, surfacing.
• Automate data pipelines using Azure stack, Databricks, Data Factory.
• Translate business requirements into technical specifications for development.
• Analyze source data and perform batch and real-time data ingestion (files, APIs, Kafka, Spark Streaming).
• Develop ETL using Spark and enable data exports, APIs, or visualizations.

Connaissances

Team player

Analytical skills

Problem-solving

English communication

Formation

Bachelor’s degree in Computer Science/Computer Engineering/IT or related fields

Outils

Python

SQL

Spark

Databricks

Azure

Power BI

API

Description du poste

As a Data Engineer, you will: Work across workstreams to support data requirements including reports and dashboards Analyze and perform data profiling to understand data patterns and discrepancies following Data Quality and Data Management processes Understand and follow best practices to design and develop the E2E Data Pipeline: data transformation, ingestion, processing, and surfacing of data for large-scale applications Develop data pipeline automation using Azure technologies stack, Databricks, Data Factory Understand business requirements to translate them into technical requirements that the system analysts and other technical team members can drive into the project design and delivery Analyze source data and perform data ingestion in both batch and real-time patterns via various methods; for example, file transfer, API, Data Streaming using Kafka and Spark Streaming Analyze and understand data processing and standardization requirements, develop ETL using Spark processing to transform data Understand data/reports and dashboards requirements, develop data export, data API, or data visualization using Power BI, Tableau, or other visualization tools

We are looking for experience and qualifications in the following:

• Bachelor’s degree in Computer Science, Computer Engineer, IT, or related fields
• Minimum 2 years’ experience in Data Engineering fields (new graduates are also welcome for some of our job openings)
• Data Engineering skills: Python, SQL, Spark, Cloud Architect, Data & Solution Architect, API, Databricks, Azure
• Data Visualization skills: Power BI (or other visualization tools), DAX programming, API, Data Model, SQL, Story Telling and wireframe design
• Business Analyst skills: business knowledge, data profiling, basic data model design, data analysis, requirement analysis, SQL programing
• Basic knowledge in Data Lake/Data Warehousing/ Big data tools, Apache Spark, RDBMS and NoSQL, Knowledge Graph
• Experience working in a client-facing/consulting environment is a plus Team player, analytical and problem-solving skills Good communication skills in English

About Accenture

We work with one shared purpose: to deliver on the promise of technology and human ingenuity. Every day, more than 775,000 of us help our stakeholders continuously reinvent. Together, we drive positive change and deliver value to our clients, partners, shareholders, communities, and each other.We believe that delivering value requires innovation, and innovation thrives in an inclusive and diverse environment. We actively foster a workplace free from bias, where everyone feels a sense of belonging and is respected and empowered to do their best work.At Accenture, we see well-being holistically, supporting our people’s physical, mental, and financial health. We also provide opportunities to keep skills relevant through certifications, learning, and diverse work experiences. We’re proud to be consistently recognized as one of the World's Best Workplaces.

Join Accenture to work at the heart of change. Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences.All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law.Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities. Bring your incredible skills and join our global team of innovators. We come together from different backgrounds across the world and work with the latest technologies to create value and growth for our clients.

With us, you’ll continue to learn and grow so you can advance in your career. Your personal dreams and ambitions are just as important to us; that’s why we offer support any way we can—when you thrive, we all thrive.

Explore your next step at Accenture Belong. Grow. Thrive. Join a great place to work for reinventors who drive meaningful change for our clients, communities, and the world. Wo rld. Explore your next step at Accenture