Big Data Engineer

KCS iT; Lisboa; Hybrid; EUR 70,000 - 90,000; Full time

Job summary

KCS IT in Lisbon is seeking a Senior Big Data Engineer to design, develop and maintain scalable data platforms for international projects. You will collaborate with Paris-based teams and drive data pipelines using Spark, Hadoop and related tech.

The role demands 5+ years of hands-on Big Data experience, strong CI/CD, DevOps mindset, and proficiency in English (B2). Hybrid Portugal work model with global teams and opportunities for growth are offered.

Qualifications

• Proven experience as a Big Data Engineer with large-scale data platforms.
• Strong hands-on with Spark, Python, Hadoop, Hive, SQL, Linux, APIs and Kafka.
• Solid software development and CI/CD practices.
• Experience with source control Git.
• Experience with deployment tools XL Release and XL Deploy.
• Experience with scheduling CTRL-M.
• Good understanding of Big Data ecosystems and distributed processing.
• Familiarity with DevOps concepts.
• Strong problem-solving and analytical skills.
• English level B2 required.
• Ability to work in international distributed teams.
• Autonomous, organized, able to manage priorities.
• Positive, collaborative, proactive mindset.

Responsibilities

• Design, develop, and maintain scalable Big Data solutions.
• Work closely with Paris-based teams in an international environment.
• Develop and optimize data processing pipelines using Spark and related technologies.
• Implement and maintain robust CI/CD processes.
• Monitor and improve platform performance and reliability.
• Collaborate with cross-functional teams to deliver high-quality solutions.
• Ensure the adoption of development best practices and coding standards.
• Contribute to technical discussions and knowledge sharing across teams.
• Troubleshoot and resolve complex technical issues within Big Data environments.

Skills

Big Data

Spark

Python

Hadoop

Hive

SQL

Linux

APIs

Kafka

CI/CD

Git

XL Release

XL Deploy

CTRL-M

DevOps

English B2

International teams

Tools

Git

XL Release

XL Deploy

CTRL-M

Job description

We’re looking for the special, unique and amazing YOU!

@KCS IT, we look for the ones that stand out, for those who always want to be better and fight for it, and for those who share the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, and teamwork.

We are looking for an Amazing:

Seniority:

Senior (+5 years of experience)

Type of position:

Hybrid | Portugal

The amazing you, will have:

• Proven experience as a Big Data Engineer;
• Strong hands-on experience with Spark, Python, Hadoop, Hive, SQL, Linux, APIs, and Kafka;
• Solid experience in software development and CI/CD practices;
• Experience with Source Code Management tools, namely Git;
• Experience with deployment and release management tools such as XL Release and XL Deploy;
• Experience with scheduling tools, namely CTRL-M;
• Good understanding of Big Data ecosystems and distributed data processing;
• Familiarity with DevOps concepts;
• Strong problem-solving and analytical skills;
• Good level of English (minimum B2 mandatory);
• Ability to work effectively in international and distributed teams;
• Autonomous, organized, and capable of managing priorities;
• A positive, collaborative, and proactive mindset.

To turn yourself from amazing to unique, you'll have (plus):

• Experience in optimization and performance improvement initiatives;
• Knowledge of French;
• Experience working in international environments;
• Cloud platform knowledge;
• Passion for innovation and continuous improvement.

Key Responsibilities:

• Design, develop, and maintain scalable Big Data solutions;
• Work closely with Paris-based teams in an international environment;
• Develop and optimize data processing pipelines using Spark and related technologies;
• Implement and maintain robust CI/CD processes;
• Monitor and improve platform performance and reliability;
• Collaborate with cross-functional teams to deliver high-quality solutions;
• Ensure the adoption of development best practices and coding standards;
• Contribute to technical discussions and knowledge sharing across teams;
• Troubleshoot and resolve complex technical issues within Big Data environments.

Why should you become part of our family?

• You can develop a career that fits you: your career development is personalized, taking into consideration your needs and goals from the short to long term;
• Interesting Challenges Ahead: you can work for several clients from different sectors of activity;
• Free training programs: Our training and certification programs in languages, tech, behavior, and business will help you reach your full potential faster;
• International projects in Benelux: you can gain international experience in Benelux and balance a new way of living with work;
• Type of projects (depending on the project you might find one of these types of projects):
• In Hybrid Systems: It is important to balance work with socialization, that's why a hybrid system works for us and for you;
• Full Remote Projects: If you want to work while enjoying the comfort of your home;
• Full Onsite Projects: If you prefer the company of your colleagues!
• Take care of your well-being: Enjoy our free nutrition, psychologist, general medicine appointments, and our yoga and personal training days... all remote!

Who are we?

Founded in 2008 and based in Lisbon, KCS IT is a consulting company in the field of Information Technology and Services, focused on creating value for our clients through three main areas: Consulting, Outsourcing, Innovation, and Training.

Our commitment to talent development is unmistakable in the recent opening of the Porto, Leiria, and Azores hubs, which aim to develop technology for the national and international markets. Since 2018, we have been elected one of the 10 major companies in the “Index of Excellence”, an initiative that aims to reward organizations that invest the most in the development and satisfaction of their employees.

At KCS IT, we stand for equality and value diversity. We foster a safe, diverse environment where opportunities are equal for all employees! We do not discriminate based on age, ethnicity, sexual orientation, gender, disability, or any factor other than merit. All applications with the required skills for the position are welcome!