Big Data Engineer – Data Lake (ODS)

JR Spain; Bilbao; Presencial; EUR 50.000 - 70.000; Jornada completa

Descripción de la vacante

A leading software development company in Bilbao is looking for a Big Data Developer. The role involves designing and implementing big data environments with a strong focus on Scala and Spark technologies. Candidates should have 5+ years of experience in big data technologies and database management. The company offers a dynamic environment with growth opportunities, competitive salary, and a collaborative culture.

Servicios

Competitive salary and benefits

Dynamic, agile environment

International project collaboration

Excellent work environment and social clubs

Formación

• 5+ years of experience with Scala, Spark, software design patterns, and TDD.
• Experience with big data technologies, especially Spark; Hadoop, Hive, and Kafka are a plus.
• Experience with various database structures including SQL and NoSQL.

Responsabilidades

• Design and implement production big data environments using modern technologies.
• Build, validate, and optimize large-scale big data solutions.
• Develop and manage ETLs in batch and streaming.

Conocimientos

Scala

Spark

Software design patterns

TDD

Big data technologies

AWS ecosystem

Continuous integration

DevOps tools

Proficiency in English

Educación

Bachelor’s Degree in Computer Science or related field

Herramientas

Git

Jenkins

Sonar

Nexus

Jira

Splunk

Descripción del empleo

Open Digital Services is the software development company of Santander Group, powering the next generation of banks by creating innovative banking products and collaborating with Santander Group Affiliates.

Santander Group is one of the world's largest financial institutions and the Eurozone's leader. We are committed to being the best Digital Bank with a presence in the industry.

Our mission at ODS is to design and support an advanced digital and omnichannel platform, ensuring the best customer experience using cutting-edge technology. Openbank, our flagship partner, develops our most advanced concepts. Join our team to help create unique value for our customers!

We offer an environment for tackling exciting tech challenges in an agile setting, with opportunities for learning, growth, and international careers.

We are currently looking for Big Data Developers to strengthen our team.

Responsibilities:

• Design and implement production big data environments using modern technologies.
• Build, validate, and optimize large-scale big data solutions in heterogeneous data environments.
• Develop and manage ETLs in batch (Spark and Scala) and streaming (Apache Flink).

Requirements:

• + years of experience with Scala, Spark, software design patterns, and TDD.
• Experience with big data technologies, especially Spark; Hadoop, Hive, and Kafka are a plus.
• Experience with various database structures, including SQL (Postgres, MySQL) and NoSQL (DynamoDB, DocumentDB, Redis, Elasticsearch).
• Experience with data integration and management involving high data volumes.
• Experience with AWS ecosystem (EMR, EC2, IAM, GLUE, ATHENA, S3, CloudFormation, LakeFormation, Redshift, DynamoDB, RDS, ECS, ECR) is a plus.
• Experience with agile, continuous integration, and DevOps tools (Git, Jenkins, Sonar, Nexus, Jira, Splunk).
• Bachelor’s Degree in Computer Science, Information Systems, Mathematics, or related STEM fields, or equivalent experience.
• Proficiency in English.

Nice to have:

• Experience with data warehousing, Apache Iceberg, and visualization tools.
• Experience with NRT applications like Apache Flink and Spark Streaming.

What we offer:

• A dynamic, agile environment with growth opportunities.
• Work in a start-up mode supported by Santander Group in a growing expansion project.
• Competitive salary and benefits.
• International project collaboration.
• Excellent work environment, social clubs, and events.

Join us to grow with a company that values social and diversity clubs as part of its culture!