Senior Spark & Databricks Data Engineer - Azure & Streaming

Accenture Poland; Kraków; Hybrid; PLN 240,000 - 340,000; Full time

Benefits offered by this job

Private medical care

Life insurance

Employee referral program

Training package

Job summary

Accenture Poland is seeking an experienced Data & Applied Intelligence engineer to design, build, and optimize strategic data pipelines and streaming architectures. You will work with Spark, Databricks, PySpark, Python, Java, and Azure in a hybrid environment with cross-functional teams.

Expect opportunities to scale high-availability data processing, contribute to DevOps pipelines, and collaborate with stakeholders in Agile settings.

Qualifications

• 7+ years of software engineering or data engineering experience.
• Extensive hands-on experience with Spark, Databricks, and PySpark.
• Strong development skills in Python and Java.
• Deep experience with Azure Cloud technologies.
• Experience working with Kubernetes, Kafka architectures, and streaming data.
• Experience implementing and maintaining DevOps practices and CI/CD pipelines.
• Strong analytical and problem-solving skills with the ability to work independently on complex technical challenges.
• Excellent communication skills and experience collaborating with business and technology stakeholders in Agile environments.

Responsibilities

• Design, develop, and enhance a strategic data pipeline that feeds and reconciles inbound data from deal stores to regulatory and settlement systems.
• Build and optimize high-performance, high-availability, low-latency distributed data processing solutions.
• Develop and maintain streaming architectures leveraging Kafka and cloud-native services within Azure.
• Collaborate with cross-functional Agile teams to analyze complex technical flows, identify improvements, and propose effective technical solutions.
• Contribute to DevOps practices, CI/CD pipelines, containerized deployments, and Kubernetes-based environments.
• Support production stability, including investigation and resolution of complex technical issues.
• Communicate technical and non-technical concepts effectively to business and technology stakeholders.
• Drive continuous improvement by independently solving challenging technical problems and enhancing existing platforms.

Skills

Spark

Databricks

PySpark

Python

Java

Azure

Kubernetes

Kafka

CI/CD

DevOps

Data engineering

Software engineering

Tools

Spark

Job description

Accenture Poland is seeking an experienced Data & Applied Intelligence engineer to design, build, and optimize strategic data pipelines and streaming architectures. You will work with Spark, Databricks, PySpark, Python, Java, and Azure in a hybrid environment with cross-functional teams.

Expect opportunities to scale high-availability data processing, contribute to DevOps pipelines, and collaborate with stakeholders in Agile settings.