Senior Big Data Engineer

Decskill; Portugal; Presencial; EUR 60 000 - 90 000; Tempo integral

Resumo da oferta

Decskill is seeking a Senior Big Data Engineer to optimize data pipelines and drive performance improvements across our distributed teams.

You will work with Spark, Python, Hadoop, Hive, SQL, Kafka, and CI/CD to deploy robust data solutions, collaborating with cross-functional teams in Lisbon, Porto, Madrid, and Luxembourg.

Qualificações

• Strong experience with Spark, Hadoop, Hive and Kafka.
• Proficient in Python and SQL for data processing.
• Hands-on with CI/CD, Git and release/deploy tooling.

Responsabilidades

• Optimize and improve performance of data pipelines and ETL processes.
• Apply DevOps concepts to data infrastructure and workflows.

Conhecimentos

Spark

Python

Hadoop

Hive

SQL

API

Kafka

CI/CD

Git

XL Release

XL Deploy

Descrição da oferta de emprego

Decskill, founded in 2014 as an IT Consulting Company, places paramount importance on its greatest asset: its people. Our main mission is to deliver value through knowledge and talent, and we achieve this by fostering a culture of excellence and investing in the development and well-being of our people. With over 600 dedicated professionals and offices in Lisbon, Porto, Madrid, and Luxembourg, Decskill operates across three core areas:

Decskill Talent: We believe that our people are key to our success.

Through Decskill Talent, we empower our team to embrace the digital transformation challenges of our clients. We collaborate with clients to drive innovation, ensuring project success and business growth.

Decskill Boost: Equipping our team with the latest tools and methodologies, we optimize Time-to-Market and deliver innovative solutions exceeding client expectations.

Decskill Connect: Our team collaborates closely with clients to implement and manage IT infrastructures that generate long-term value.

At Decskill, we believe that by nurturing and empowering our people to confront the challenges of digital transformation, we create value not only for our clients but also for our entire ecosystem, fostering a digital community dedicated to growth and progress.

We are looking for a Senior Big Data Engineer

Responsibilities:

• Optimization and performance improvement experience;
• DevOps concepts.

Requirements:

Technical

• Spark;
• Python;
• Hadoop;
• Hive;
• SQL;
• API;
• Kafka;
• CI/CD;
• Source Code Management (Git);
• Build - XL Release;
• Deploy - XL Deploy;

Soft Skills

• Positive and collaborative mindset;
• Ability to work in an international and distributed team;
• Autonomy;
• Organization;
• Willingness to learn and share knowledge;
• Innovative thinking;

Languages

Decskill is committed to equality and non-discrimination with all our talents. We recruit and promote talent, based on diversity and inclusion, regardless of age, gender, ethnicity, race, nationality or any other form of discrimination incompatible with the dignity of the human being.