Backend Spark Engineer: Data Pipelines & SQL

Cloudspirit; Warszawa; In loco; PLN 140.000 - 200.000; Tempo pieno

Descrizione del lavoro

Talan is an international consulting group specializing in innovation and business transformation through technology. With over 7,200 consultantsin 21 countriesand a turnover of €850M, we are committed to delivering impactful, future-ready solutions.

Talan at a Glance

Headquartered in Paris and operating globally, Talan combines technology, innovation, and empowermentto deliver measurable results for our clients. Over the past 22 years, we’ve built a strong presence in the IT and consulting landscape, and we’re on track to reach €1 billion in revenuethis year.

Our Core Areas of Expertise

• Data & Technologies:We design and implement large-scale, end-to-end architecture and data solutions, including data integration, data science, visualization, Big Data, AI, and Generative AI.
• Cloud & Application Services:We integrate leading platforms such as SAP, Salesforce, Oracle, Microsoft, AWS, and IBM Maximo, helping clients transition to the cloud and improve operational efficiency.
• Management & Innovation Consulting:We lead business and digital transformation initiativesthrough project and change management best practices (PM, PMO, Agile, Scrum, Product Ownership), and support domains such as Supply Chain, Cybersecurity, and ESG/Low-Carbon strategies.

We work with major global clients across diverse sectors, including Transport & Logistics, Financial Services, Energy & Utilities, Retail, and Media & Telecommunications.

Job Description

We are looking for a Mid-Level Backend Spark Developer to join our Markets technology team. The successful candidate will contribute to the development and maintenance of data processing solutions using Spark and SQL-based technologies. This role involves working in a collaborative, agile environment, supporting data-driven initiatives, and improving existing systems through proactive analysis and teamwork.

The position is onsite and may be assigned to either the Málaga hub or the Poland hub, depending on business needs and geographic diversity guidelines.

Key Responsibilities

• Develop, maintain, and optimize data pipelines using Apache Spark
• Write efficient and scalable queries using SQL (ANSI SQL, Hive SQL, Spark SQL)
• Collaborate with cross-functional teams to analyze and refine business and technical requirements
• Participate in code reviews and ensure best practices in coding and version control using Git
• Support data processing and transformation tasks across distributed systems
• Contribute to continuous improvement by proactively identifying inefficiencies and proposing solutions
• Work closely with team members to ensure high-quality deliverables and timely project execution

Qualifications

Required Skills

• 1.5 to 2 years of experience in data engineering or software development
• Strong knowledge of SQL (ANSI SQL, Hive SQL, Spark SQL, or similar)
• Solid understanding of Apache Spark
• Programming experience in Scala, Python, or Java
• Experience with Git or similar version control systems
• English proficiency at B2+ level or higher
• Strong analytical thinking and problem-solving skills
• Ability to work effectively in a team environment
• Proactive attitude and willingness to take initiative

Nice to Have

• Experience with Azure Databricks, Amazon EMR, or Cloudera
• Understanding of Hive
• Experience with reporting tools such as Power BI
• Exposure to data visualization and reporting concepts

Additional Information

What do we offer you?

• Hybrid position based in Warsaw, Poland.
• Permanent, full-time contract with career development opportunities.
• Chance to work in a challenging, multicultural environment with international projects.
• Exposure to large-scale financial IT systems and cross-country operations.
• Training opportunities to develop new skills in finance, technology, and data management.

Talan Spain’s commitment to non-discrimination based on gender, race, ideology, or any other reason, in accordance with the company’s "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).