Senior Spark & Databricks Data Engineer - Azure Streaming

Accenture PLC; Kraków; Hybrid; PLN 240,000 - 360,000; Full time

Benefits offered by this job

Permanent employment contract or B2B.

Individual support of a People Lead...

A wide training package (soft, tech, &

Employee Share Purchase Plan

Paid employee referral program.

Private medical care and life insured.

MyBenefit platform including Multispor

Job summary

Accenture plc in Kraków is seeking a Senior Data/Software Engineer to design and scale strategic data pipelines, feed data from deal stores to regulatory and settlement systems, and deliver high-availability streaming solutions.

You will use Spark, Databricks, PySpark, Python and Java on Azure, collaborate with Agile teams, contribute to DevOps, CI/CD, containers, and Kubernetes, and support production stability in a fast-paced client environment.

Qualifications

• 7+ years of software engineering or data engineering experience.
• Hands-on experience with Spark, Databricks, and PySpark.
• Strong development skills in Python and Java.
• Deep experience with Azure Cloud technologies.
• Experience working with Kubernetes, Kafka architectures, and streaming data.
• Experience implementing and maintaining DevOps practices and CI/CD pipelines.
• Excellent communication and collaboration with stakeholders in Agile environments.

Responsibilities

• Design, develop, and enhance a strategic data pipeline that feeds and reconciles inbound data from deal stores to regulatory and settlement systems.
• Build and optimize high-performance, high-availability, low-latency distributed data processing solutions.
• Develop and maintain streaming architectures leveraging Kafka and cloud-native services within Azure.
• Collaborate with cross-functional Agile teams to analyze complex technical flows, identify improvements, and propose effective technical solutions.
• Contribute to DevOps practices, CI/CD pipelines, containerized deployments, and Kubernetes-based environments.
• Support production stability, including investigation and resolution of complex technical issues.
• Communicate technical and non-technical concepts effectively to business and technology stakeholders.
• Drive continuous improvement by independently solving challenging technical problems and enhancing existing platforms.

Skills

Spark

Databricks

PySpark

Python

Java

Kubernetes

Kafka

DevOps

CI/CD

Agile

Communication

Analytical

Tools

Azure Cloud technologies

Kubernetes

Kafka

CI/CD pipelines

DevOps practices

Job description

Accenture plc in Kraków is seeking a Senior Data/Software Engineer to design and scale strategic data pipelines, feed data from deal stores to regulatory and settlement systems, and deliver high-availability streaming solutions.

You will use Spark, Databricks, PySpark, Python and Java on Azure, collaborate with Agile teams, contribute to DevOps, CI/CD, containers, and Kubernetes, and support production stability in a fast-paced client environment.