Big Data Developer (Spark/Scala)

Talan SAS; Warszawa; Hybrid; PLN 211,000 - 296,000; Full time

Job summary

A consulting firm is seeking a Backend Spark developer to join their hybrid team in Warsaw. The role involves developing ETL processes, working with Spark and Scala, and ensuring high-quality delivery. Candidates should have at least 2 years of experience, a solid understanding of clean code practices, and work well in an agile environment. This full-time position offers permanent benefits and opportunities for career development.

Benefits

Private medical insurance

Lunch pass card

MultiSport Plus card

Training and career development

Qualifications

• At least 2 years of experience with Spark and Scala.
• Understanding of clean code and software design patterns.
• Experience with high data volumes and data integration.

Responsibilities

• Develop end-to-end ETL processes with Spark/Scala.
• Document solutions using JIRA, Confluence, and ALM.
• Ensure integration quality through relevant tests.

Skills

Spark with Scala

Software design patterns

Agile approach

Big data experience

English (at least B2+)

Tools

Git

Jenkins

Azure Databricks

Postgres

SQL

Airflow

Job description

For the4th consecutive year,Talan Spainhas been recognized as aGreat Place to Work! 🎉 This year, we’re also celebrating our2nd certification in Poland, a significant milestone since opening our office there.

Talan is an international advisory group specializing in innovation and transformation through technology, with5,000 employeesand an annual turnover of600M€.

We offer our customers a continuum of services to support them at each key stage of their organization's transformation, with four main activities:

• CONSULTINGin Management and Innovation: Supporting business, managerial, cultural, and technological transformations.
• DATA & TECHNOLOGY:Implementing major transformation projects.
• CLOUD & APPLICATION SERVICES:Building or integrating software solutions.
• SERVICE CENTERS of EXCELLENCE:Providing technology, innovation, agility, sustainability of skills, and cost optimization.

Talan accelerates its clients' transformation through innovation and technology. By understanding their challenges and supporting them withtechnology, innovation, and data, we enable them to be more efficient and resilient.

Job Description

As a Backend Spark developer, your mission will be to develop, test and deploy the technical and functional specifications from the Solution Designers / Business Architects / Business Analysts, guaranteeing the correct operability and the compliance with the internal quality levels.

We need somebody like you to help us in different fronts:

• You will develop end-to-end ETL processes with Spark/Scala. This includes transferring data from/to the data lake, technical validations, business logic, etc.
• You will use Scrum methodology, and be part of a high performance team.
• You will document your solutions in the client tools: JIRA, Confluence, ALM.
• You will certify your delivery and its integration with other components, designing and performing the relevant test to ensure the quality of your team delivery.

Qualifications

Required qualifications

• At least 2 years of experience working with Spark with Scala, software design patterns, and TDD.
• Knowledge of good practices in writing code: clean code, software design patterns, functional style of writing code.
• Experience in working with big data – Spark, Hadoop, Hive. Knowledge of Azure Databricks is considered as a plus.
• Agile approach for software development
• Experience and expertise across data integration and data management with high data volumes.
• Experiencie working in agile continuous integration/DevOps paradigm and tool set (Git, GitHub, Jenkins, Sonar, Nexus, Jira)
• Experience with different database structures, including (Postgres, SQL, Hive)
• English (at least B2+)

Preferred qualifications

• CI/CD: Jenkins, GitHub Actions
• Orchestration: Control-M, Airflow
• Scripting: Bash, Python
• Basics of cybersecurity & Quality (Sonar, Fortify…)
• Basics of Cloud computing (Docker, Kubernetes, OS3, Azure, AWS)

Additional Information

What do we offer you?

• Permanent, full-time contract
• Training and career development
• Benefits and perks such as private medical insurance, lunch pass card, MultiSport Plus card
• Possibility to be part of a multicultural team and work on international projects
• Hibrid position based in Warsaw, Poland. Realocation is mandatory.
• Possibility to manage work-permits.

If you are passionate about development & tech, we want to meet you!