L3 support specialist with BigData

Luxoft; Wrocław; Hybrid; PLN 150,000 - 220,000; Full time

Job summary

Luxoft is seeking a seasoned Big Data Platform Engineer in Wrocław to help scale the ACQA platform on Microsoft Azure. You will collaborate with global teams to enable BigData solutions on Databricks and support platform reliability across finance, risk, and front office.

Responsibilities include delivering monitoring tooling, upgrades, and best-practice guidance for runtime environments, while leveraging Spark, Java/Scala, and containerized workloads in a cloud-native setup.

Qualifications

• Big data tech with Apache Spark.
• Java/Scala production systems.
• Azure cloud platform experience.
• CI/CD pipelines with GitLab.
• Containerisation with Kubernetes.

Responsibilities

• Work with multiple federated teams to enable them to build BigData solutions.
• Manage the ACQA Databricks platform – provide monitoring and other tooling.
• Provide best-practices for runtime upgrades.

Job description

Project description

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:Scalable cost-efficient infrastructure, using cloud PaaS components.Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.Shared across Front Office, Finance and Risk, improving regulatory compliance.One-Platform / One-Experience -fast to train, easy to operate, retaining talent.The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

Responsibilities

• Work with multiple federated teams to enable them to build BigData solutionsManage the ACQA Databricks platform – provide monitoring and other toolingProvide best-practices for runtime upgrades

SKILLS

Must have

• Development of big data technologies like Apache SparkProgramming complex production systems in Java and ScalaExperience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLabExperience with containerisation in development, build and runtime environments including experience of Kubernetes

Nice to have

Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)Databricks experiencePython experienceTesting and instrumentation practices, observability and alerting toolingUnderstanding of information modelling, data structures and algorithmsTechnical architecture and low-level designAgile development and planning practicesAbility to collaborate effectively in a large global team and influence key architectural decisions