Data Engineer

Yechte; Brussel Hoofdstad; Hybride; EUR 70 000 - 100 000; Plein temps

Avantages offerts par ce poste

Flexi-hours

Hybrid work

Mobility plan

Food allowances

Healthcare support

IT trainings & certifications

Résumé du poste

yechte in Brussels, Belgium is seeking a Data Engineer with strong experience in developing and maintaining data solutions within enterprise environments. You will design and deliver data pipelines using Python, PySpark, Databricks, and AWS, focusing on data processing, ETL, data management, and production support.

Collaborating with multidisciplinary teams, you will help industrialise business processes, support costing, exposure management, and forecasting activities for gas and power, while

Qualifications

• Proven experience as a Data Engineer or in a similar data development role.
• Strong hands-on experience with Python V3.
• Experience with PySpark and Databricks.
• Experience with AWS and SQL.
• Experience with ETL development and data transformation.
• Ability to participate in architecture discussions and solution design.
• Strong analytical and problem solving skills.

Responsabilités

• Develop and maintain data solutions within the data framework.
• Design and implement scalable data processing and transformation solutions.
• Develop data pipelines using Python and PySpark.
• Build and execute ETL processes using Databricks.
• Work with Apache Spark and manage Spark clusters.
• Develop and optimise SQL queries for efficient data processing.
• Work with relational databases and data warehouses.
• Write and maintain technical specifications.
• Write and execute unit tests to ensure solution quality.
• Participate in architecture discussions and contribute to technical solution design.
• Apply and implement best practices around data management.
• Ensure data solutions comply with agreed technical and architectural standards.
• Deliver within timelines and quality standards.
• Perform production monitoring and maintenance.
• Analyse and resolve production issues affecting data solutions.
• Collaborate with multidisciplinary teams and stakeholders.
• Translate customer requirements into effective data solutions.

Connaissances

Python

PySpark

Databricks

AWS

SQL

Data pipelines

ETL development

Spark clusters

Outils

Airflow

Azure DevOps

Terraform

Postman

Description du poste

Job DetailsData ScienceMediorPerm/ContractBelgium, BrusselsFull TimeHybridApply NowHiring ProcessTime to Answer2 open daysProcess1 Phone Call1 Onsite InterviewDays to get an Offer4 Days after InterviewMore InfoOverviewData Engineer with strong experience in developing and maintaining data solutions within enterprise environments. Responsible for designing and delivering data solutions using Python, PySpark, Databricks, and AWS, with a strong focus on data processing, ETL development, data management, and production support. The role contributes to the industrialisation and securing of business processes within the Downstream IT application landscape, supporting costing processes, exposure management, and forecasting activities for gas and power. Works closely with multidisciplinary teams and stakeholders to deliver scalable, reliable, and high-quality data solutions while following architectural and data management best practices.Job ResponsibilitiesDevelop and maintain solutions within the data framework.Design and implement scalable data processing and transformation solutions.Develop data pipelines using Python and PySpark.Build and execute ETL processes using Databricks.Work with Apache Spark and manage Spark clusters.Develop and optimise SQL queries for efficient data processing.Work with relational databases and data warehouses.Write and maintain technical specifications.Write and execute unit tests to ensure solution quality.Participate in architecture discussions and contribute to technical solution design.Apply and implement best practices around data management.Ensure data solutions comply with agreed technical and architectural standards.Ensure deliveries are completed within agreed timelines and quality standards.Perform production monitoring and maintenance.Analyse and resolve production issues affecting data solutions.Collaborate with multidisciplinary teams and stakeholders.Understand customer requirements and translate them into effective technical solutions.Contribute to the continuous improvement of data engineering processes and solutions.Must Have SkillsProven experience as a Data Engineer or in a similar data development role.Strong hands-on experience with Python V3.Strong experience with PySpark.Strong experience with Databricks.Strong experience with AWS.Solid understanding of:SQLRelational databasesData warehousesExperience with ETL development and data transformation.Experience with Databricks, including:Creating and executing ETL tasks.Managing Spark clusters.Optimising SQL queries.Experience writing technical specifications.Experience writing unit tests.Good understanding of data management best practices.Ability to participate in architecture and solution design activities.Strong analytical and problem-solving skills.Ability to work independently and proactively.Strong communication and interpersonal skills.Ability to work effectively in a multidisciplinary environment.Ability to understand customer requirements and deliver appropriate data solutions.Experience with production monitoring and maintenance.Nice to haveExperience with Apache Airflow.Experience with Azure DevOps / TFS / VSTS.Experience with Terraform.Experience with Insomnia / Postman.Knowledge of CI/CD practices.Knowledge of C#.Knowledge of the energy market industry.Knowledge of portfolio management.Knowledge of risk management.Knowledge of Trading.Knowledge of energy forecasting activities.Experience with Web APIs.Knowledge of Agile methodology.Experience within the energy trading or energy forecasting domain.What's great in the job?Work on strategic data engineering initiatives within the energy sector.Contribute to the industrialisation and securing of critical business processes.Work with modern technologies including Python, PySpark, Databricks, AWS, and Apache Spark.Contribute to scalable and reliable data solutions supporting gas, power, costing, exposure management, and forecasting.Collaborate with multidisciplinary teams across Data, IT, Architecture, and Business.Participate in architecture discussions and contribute to data engineering best practices.Work in a dynamic and fast-paced environment focused on innovation and continuous improvement.Opportunity to contribute to the evolution of the Downstream IT application landscape.Work at yechteWe are an independent digital consultancy with ambitious goals and a global presence. We support a diverse range of companies, building digital teams and delivering innovative digital solutions. Our multicultural and diverse workforce, comprised of ‘Global Citizens’, reflects this inclusivity.We care about work-life balance and meeting the expectation of a growing team, investing in people because they are our greatest asset. Our consistent growth is a testament to this commitment.Come work at yechte, a company on the rise, offering excellent benefits, opportunities for personal development, and the chance to learn from accomplished leaders. We are always looking for exceptional professionals to join our team.What We OfferEach employee has a chance to see the impact of his work. You work on real digital projects and make tangible contributions to the company. We want to provide to each individual personal, professional and social growth.FlexibilityWe care about your wellbeing. At yechte we offer flexi-hours and hybrid home/office work arrangements, enhancing employee work-life balance and productivity.Attractive BenefitsWe care about your comfort. At yechte we offer cost-effective and eco-friendly mobility plans, food allowances, and comprehensive healthcare support, enhancing employee satisfaction.Personal DevelopmentWe care about your growth. At yechte we offer to boost your personal growth through tailored IT trainings and certifications, fostering a culture of agility and tech-driven expertise.