Data Engineering Lead Porto, Portugal

Metyis; Porto; Presencial; EUR 65 000 - 95 000; Tempo integral

Resumo da oferta

Metyis is seeking a senior data engineering professional to lead end-to-end ETL/Lakehouse initiatives on Azure, with responsibilities spanning architecture, data governance and analytics product delivery.

You will work with data scientists and cross-functional teams to design data platforms, dashboards and APIs, driving scalable data products and strategic insights.

Qualificações

• 5–8 years of experience in a similar role with ETL development and deployment on Azure, GCP or AWS.
• Solid knowledge of data warehousing principles (ODS, data marts, data lakes, data vault, 3NF).
• Strong understanding of cloud-based development platforms, advanced analytics, computing environments, and GitHub/CI-CD workflows.
• Experience setting up automated testing frameworks (unit/integration tests).
• Knowledge of modern cloud-based architectures (Lambda & Kappa).
• Advanced SQL, data transformation, and data profiling skills.
• Experience building production ETL/ELT pipelines at scale.
• Data governance experience.
• 3–5 years hands-on with Azure: Data Factory, Databricks, Synapse, Functions, streaming.
• Experience with Airflow, Kubernetes; Great expectations is a plus.
• PowerBI knowledge is a plus.
• Customer-centric and committed to delivering digital products.
• Engineering craftsmanship mindset and collaborative work style.
• Strong problem-solving and ability to convey designs to a wider audience.
• People management experience (min 2-person team).
• Experience in service consulting and stakeholder management.
• Comfortable with ambiguity, highly autonomous.
• Bachelor's degree in related technical discipline (Master's a plus).

Responsabilidades

• Lead, influence & implement the technical roadmap of our clients, aligning with overall technology strategies.
• Ensure architecture coherence where technical components deliver customer needs.
• Lead and develop digital development and operations using Python, Spark, RESTful API, and Microsoft Azure Cloud.
• Steer technical excellence with best practices and standards.
• Coach and enable other product team members to deliver high-quality products.
• Deliver data platforms and insights; collaborate with data science for data products and dashboards.
• Lead project activities and evaluate business needs with stakeholders.

Conhecimentos

Python

Spark

RESTful API

SQL

Data transformations

Data profiling

Cloud architectures

Problem solving

Team leadership

Stakeholder management

Formação académica

Bachelor's degree in CS/Math/Economics/Engineering/OR related technical discipline

Master's degree (plus)

Ferramentas

Azure Data Factory

Databricks

Synapse

Azure Functions

Airflow

Kubernetes

PowerBI

GitHub/CI-CD

Descrição da oferta de emprego

The next step of your career starts here, where you can bring your own unique mix of skills and perspectives to a fast-growing team.

Metyis is a global and forward-thinking firm operating across a wide range of industries, developing and delivering AI & Data, Digital Commerce, Marketing & Design solutions and Advisory services. At Metyis, our long-term partnership model brings long-lasting impact and growth to our business partners and clients through extensive execution capabilities

With our team, you can experience a collaborative environment with highly skilled multidisciplinary experts, where everyone has room to build bigger and bolder ideas. Being part of Metyis means you can speak your mind and be creative with your knowledge. Imagine the things you can achieve with a team that encourages you to be the best version of yourself.

We are Metyis. Partners for Impact.

What we offer

Interact with senior stakeholders at our clients on regular basis to drive their business towards impactful change.

Become the go-to person for end-to-end data handling, management, and analytics processes.

Lead your team in creating the pipeline for Data management, data visualization, and analytics products, including automated services, and APIs.

Working with Data Scientists to take data throughout its lifecycle - acquisition, exploration, data cleaning, integration, analysis, interpretation, and visualization.

Become part of a fast-growing international and diverse team.

What you’ll do

• Lead, influence & implement the technical roadmap of our clients, in light of overall technology and architecture roadmaps.
• Be responsible for the Architecture, making sure that technical and non-technical components work together in the product to deliver the customer needs.
• Lead and Develop the digital development and operations using Python, Spark, RESTful API, and Microsoft Azure Cloud, ideally with some Data Insights experience.
• Steer the technical excellence of the application and consistency with relevant digital frameworks, best practices, and standards.
• Coach and enable other product team members to deliver best-in-class products.
• Deliver data platforms, data insights and with the collaboration of the data science team – data products, such as recommendation systems, data lakes/hubs, data insights and dashboards.
• Lead project activities and will be responsible for the evaluation of business needs and objectives in collaboration with the project team and other stakeholders.

What you’ll bring

• 5 – 8 years of experience in a similar role with experience in developing and deploying ETL solutions on Azure, GCP or AWS.
• Solid knowledge of data warehousing principles, concepts, and best practices (e.g. ODS, data marts, data lakes, data vault, 3NF).
• Good understanding of common platforms and practices regarding digital development; Cloud-based setups, Advanced Analytics and computing environments, and GitHub (or similar) and CI/CD workflows.
• Experience in setting up automated testing frameworks including unit tests, integration tests.
• Understanding of modern cloud-based architecture (Lambda & Kappa architectures).
• Advanced SQL, data transformation, and data profiling skills.
• Experience in building production ETL/ELT pipelines at scale.
• Data governance experience.
• 3 – 5 years of hands-on experience with Azure: Data Factory, Databricks, Synapse (DWH), Azure Functions, App logic, and other data analytics services, including streaming.
• Experience with Airflow, Kubernetes, Great expectations is a plus.
• Basic knowledge of PowerBI is a plus.
• Customer-centric, passionate about delivering great digital products and services.
• Demonstrating true engineering craftsmanship mindset.
• Passionate about continuous improvement and working collaboratively.
• Strong problem-solving skills coupled with the ability to convey designs and ideas to a wider audience.
• People Management experience (at least 2members team).
• Experience in service consulting and stakeholder management.
• Comfortable with ambiguity, highly autonomous.
• A Bachelor's Degree in Computer Science, Mathematics, Economics, Engineering, Operations Research. Statistics, Business or other related technical disciplines (Master's Degree is a plus).

We are united by our differences

At Metyis, we are driven by curiosity and collaboration. We value diversity, equity, inclusion, and belonging (DEIB) in all its forms as it makes us stronger as an organisation and promotes creativity and innovation. We welcome all talents and are committed to creating a workplace where every employee can make a meaningful impact and grow.