L3 support specialist with BigData

Luxoft; Polska; On-site; PLN 180,000 - 300,000; Full time

Benefits offered by this job

LuxMed health

Dental care

Life and travel insurance

MyBenefit program

EAP for you and family

Car rental options

LuxTalent platform access

Internal Mobility Program

Job summary

Luxoft is seeking a senior Big Data Platform Engineer to join the ACQA initiative on Microsoft Azure. You will work with federated teams to build scalable data solutions and manage the Databricks platform with monitoring and tooling.

The role requires production Java/Scala development, CI/CD with GitLab, and containerization with Kubernetes on Azure, leveraging extensive platform engineering experience.

Qualifications

• Big data and cloud platform experience with Azure.
• Strong Java/Scala production system development.
• Experience building and operating CI/CD pipelines (GitLab).
• Containerisation with Kubernetes in development and runtime.

Responsibilities

• Develop and operate big data solutions on Azure.
• Collaborate with federated teams to deliver data platforms.
• Manage ACQA Databricks platform including monitoring.
• Contribute to scalable, cost-efficient cloud infrastructure.

Skills

Apache Spark

Java

Scala

Azure

CI/CD (GitLab)

Kubernetes

Big Data

7+ years experience

Tools

GitLab

Terraform

Databricks

Kubernetes

Job description

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:

• Scalable cost-efficient infrastructure, using cloud PaaS components.
• Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
• Shared across Front Office, Finance and Risk, improving regulatory compliance.
• One-Platform / One-Experience -fast to train, easy to operate, retaining talent.

The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

Work with multiple federated teams to enable them to build BigData solutions

Manage the ACQA Databricks platform – provide monitoring and other tooling

Mandatory Skills Description:

• Development of big data technologies like Apache Spark
• Programming complex production systems in Java and Scala
• Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
• Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
• Experience with containerisation in development, build and runtime environments including experience of Kubernetes
• 7+ years of general experience

Nice-to-Have Skills Description:

• Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
• Testing and instrumentation practices, observability and alerting tooling
• Understanding of information modelling, data structures and algorithms
• Technical architecture and low-level design
• Agile development and planning practices
• Ability to collaborate effectively in a large global team and influence key architectural decisions

Our Benefits:

• Stable employment based on an employment contract
• Copyright-based remuneration for Developers, resulting in a higher net salary
• LuxMed private health and dental care
• Life and travel insurance
• MyBenefit program (sports card, well-being initiatives, and more)
• Employee Assistance Program for you and your family, including psychological consultations, coaching sessions, and support in personal matters
• Car rental options

Learning & Development

• Access to the LuxTalent platform, offering webinars, training sessions, and certified courses
• Internal Mobility Program, enabling rotation between projects, locations, and accounts