Senior Data Engineer (Azure & Databricks)

InnoTech; Portugal; Presencial; EUR 45 000 - 75 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Mental health support

25 days vacation

Birthday/bridging day

Petsitting partnerships

Pet bereavement day

Team events

InnoSports initiatives

Sustainability initiatives

Resumo da oferta

InnoTech is seeking a data engineer to design and run scalable data solutions in Databricks. You will develop PySpark workflows, build ETL/ELT pipelines with Delta Lake, and ensure reliable batch and streaming processing.

The role emphasizes governance and platform reliability while collaborating with cross-functional teams. Ideal candidates bring strong SQL, Spark architecture knowledge, and EU work eligibility.

Qualificações

• Proven Databricks experience with Workspaces, Notebooks, Workflows, and Unity Catalog.
• Strong PySpark, Spark SQL and distributed workload optimisation skills.
• Advanced SQL with complex joins, windows and aggregations.
• Solid ETL/ELT, Delta Lake, CDC, and data modelling knowledge.
• CPLP nationality or EU work permit required.

Responsabilidades

• Develop and maintain scalable data solutions in the Databricks ecosystem.
• Build and optimise PySpark applications for large datasets.
• Design ETL/ELT pipelines using Delta Lake and Medallion Architecture.
• Orchestrate batch and streaming data workflows for reliability.
• Collaborate to improve data performance, governance, and platform reliability.

Conhecimentos

Databricks

PySpark

Spark SQL

SQL

Data modelling

ETL/ELT

CDC

Delta Lake

Unity Catalog

Spark architecture

Formação académica

BSc in Computer Science/Engineering

MSc in IT/Engineering

Ferramentas

Pandas

NumPy

Auto Loader

Descrição da oferta de emprego

A Company you will be happy to grow with!

At InnoTech, it´s all about connecting people with business through technology.

We truly care about you, your happiness, and your well-being. We look for passionate people who are eager to learn, evolve, and grow with us - because growth is in our DNA.

This commitment has been consistently recognized: we are proud to be a Great Place to Work for five consecutive years, to be one of the Best IT Companies in Portugal, and to be recognized as a Best Workplace Wellbeing. We are also proud to hold ISO 27001 and ISO 9001 certifications, reinforcing our commitment to information security, quality, and continuous improvement.

For us, sustainability is not just a buzzword. Integrity, social responsibility, and people-first values guide everything we do.

Your Mission Will Be

• Develop and maintain scalable data solutions within the Databricks ecosystem for high-volume processing;
• Build and optimise PySpark applications to efficiently transform and analyse large datasets;
• Design and implement ETL/ELT pipelines using Delta Lake and Medallion Architecture principles;
• Orchestrate data workflows while ensuring reliable and efficient execution of batch and streaming processes;
• Collaborate with teams to improve data performance, governance, and overall platform reliability.

You Will Need

• Proven experience with Databricks, including Workspaces, Notebooks, Workflows, and Unity Catalog;
• Strong expertise in PySpark, Spark SQL, and Spark architecture, with the ability to optimise distributed workloads;
• Advanced SQL skills, including complex joins, window functions, CTEs, aggregations, and query optimisation;
• Solid understanding of data engineering concepts, including ETL/ELT pipelines, Delta Lake, CDC, and data modelling techniques;
• CPLP nationality or an EU work permit is required to facilitate employment.

Would Be Awesome If You Have

• Experience with Structured Streaming for real-time data processing;
• Knowledge of incremental loading strategies such as MERGE INTO and Auto Loader;
• Familiarity with Python libraries such as Pandas and NumPy for data analysis and automation;
• Experience designing dimensional models, Star/Snowflake schemas, or Data Vault solutions;
• BSc or MSc in Computer Science/Engineering, Information Technology, or related fields.

What We Offer

• Health-focused partnerships, including free mental health support;
• 25 days of vacation, including your birthday, Carnival, and a bridging day between Christmas and New Year;
• Half a vacation day on your children's birthday and a school supplies voucher;
• Petsitting partnerships and a pet bereavement day;
• Regular team buildings, four annual company parties, game nights, and social events;
• InnoSports initiatives (football, marathons, and more);
• Events focused on sustainability and social responsibility actions.

Are you convinced? Come see it for yourself.

Join our Top-Notch Team!