Data Engineer | Defense

Capgemini; Diegem; Sur place; EUR 60 000 - 90 000; Plein temps

Résumé du poste

Capgemini Belgium is seeking a Data Engineer to design and build scalable data pipelines and architectures for analytics and ML workloads. You will work with Python, SQL, Spark, and Docker to create robust data processing solutions and to maintain CI/CD pipelines using Jenkins, Jupyter, Superset, and Dagster.

You’ll collaborate with data scientists, software engineers, and operations, contributing to continuous improvement of data engineering standards while leveraging open-source and

Qualifications

• Master's degree in Computer Science, Engineering, Informatics or related field with Data Engineering/Sda related specialization.
• 3–5 years of solid data engineering experience.
• Proficient in Python, SQL, Spark, and Docker for data processing and automation.
• Familiar with Jenkins, Jupyter, Superset, and Dagster; experience with data warehousing and Kubeflow is a plus.
• Solid understanding of databases, data lakes, data warehouses, CI/CD pipelines, and unit testing; interest in open-source and on-premises solutions.

Responsabilités

• Design, develop, deploy, validate, and test data pipelines and architectures to support engineering and analytics needs.
• Define and implement data architectures, set up databases, data lakes, and storage for structured and unstructured data.
• Develop data pipelines to support ML workflows using Python, SQL, Spark, and Docker.
• Manage and improve CI/CD pipelines to automate testing and deployment, using Jenkins, Jupyter, Superset, and Dagster.
• Collaborate with software engineers, data scientists, and engineers to ensure data systems meet project requirements and support multiple projects.

Connaissances

Python

SQL

Spark

Docker

Jenkins

Jupyter

Superset

Dagster

Kubeflow

Git

Formation

Master's degree in Computer Science/Engineering/Informatics

Outils

Kubeflow

Description du poste

At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.YOUR ROLEIn this role you will play a key role in:Designing, developing, deploying, validating, and testing data pipelines and data architectures to support engineering and analytics needs, ensuring consistency, scalability, and performance across platformsDefining and implementing efficient data architecture and data structures, setting up, maintaining, and optimising databases, data lakes, and related storage solutions for both structured and unstructured dataDeveloping data pipelines to support the execution of machine learning algorithms and other advanced data processing workflows, leveraging tools such as Python, SQL, Spark, and DockerManaging and improving CI/CD pipelines to automate testing and deployment processes, improve code quality, and enhance development efficiency, using frameworks such as Jenkins, Jupyter, Superset, and DagsterCollaborating closely with software developers, data scientists, and engineers to ensure data systems meet project and business requirements, actively supporting multiple projects and working with Operations and inline production services to enhance the performance of defence systemsContributing to the continuous improvement of development practices, testing strategies, and data engineering standards, staying informed about the latest trends and innovations in data engineering and open-source solutionsYOUR PROFILEYou hold a Master's degree in Computer Science, Engineering, Informatics, or an equivalent field, ideally with a specialisation in Data Engineering, Data Science, or a related discipline, and bring 3 to 5 years of solid experience in data engineeringYou are proficient in Python, SQL, Spark, and Docker , particularly for data processing, AI applications, and automation, and are familiar with data engineering tools and frameworks such as Jenkins, Jupyter, Superset, and Dagster ; experience with data warehousing and Kubeflow is considered a plusYou have a good understanding of databases, data lakes, data warehouses, CI/CD pipelines, and unit testing practices, with a strong interest in open-source and on-premises solutionsAdditional knowledge in software engineering, frontend development, data analytics, C/C++, Git, DevOps, and Bitbucket would be considered an advantage, as would knowledge of MATLAB unit testingWhat you'll love about working here:Dedicated Innovation Labs – We help the world's largest innovators engineer the products and services of tomorrow by leveraging our experts and labs, dedicated to topics such as 5G, 6G, AI, Autonomous Vehicles, and Quantum. As a Data Engineer in defence, you will be working at the forefront of technological innovation.Digital Campuses and Academy – Our engineering academy offers more than 60,000 hours of training, alongside our digital campus covering GenAI, data, and sustainability. Whether you're looking to deepen your expertise in data engineering tools or explore new AI/ML methodologies, we support your learning journey at every step.Global Tech Challenges – Capgemini hosts annual group-wide competitions, such as the Global Data Science Challenge and Tech4PositiveFutures, addressing world issues like climate change and biodiversity by applying technology for innovative solutions. As a Data Engineer, you will have the opportunity to contribute your skills to challenges that go beyond your day-to-day role.Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fuelled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion.