Senior Databricks Data Engineer — Hybrid, Real-Time IoT

Anova; Porto; Híbrido; EUR 55 000 - 78 000; Tempo integral

Resumo da oferta

Anova is hiring a Data Engineer (Databricks) to join our R&D Software team in Porto. This hybrid role blends remote work with occasional in‑office collaboration to build reliable data assets used by reporting, analytics and ML across the company.

You’ll own end‑to‑end Databricks ETL, translate business goals into scalable data solutions, ensure data quality and governance, and collaborate across teams to deliver value with AI-assisted tooling.

Qualificações

• Bachelor's degree in a related field is required.
• 5+ years of experience in data engineering or a closely related role, with hands-on production experience in Databricks (6–8 years preferred).
• Significant experience building data workloads in Databricks, good understanding of PySpark and Delta Lake.
• Strong SQL with advanced features and query tuning.
• Experience with streaming or incremental ingestion (Structured Streaming, Auto Loader) and ensuring idempotency, checkpointing and schema evolution.
• Data modelling for BI and analytics.

Responsabilidades

• Build and run the Databricks pipelines that turn real-time telemetry and platform data into reliable, well-governed data assets.
• Deliver Databricks ETL projects end to end, from requirements through to pipelines running in production.
• Translate business goals into data solutions and help stakeholders make the right choices about data.
• Contribute to technical decisions, take a significant share of the implementation, and monitor pipelines once live.
• Publish and maintain data assets as master data for the organization.

Conhecimentos

SQL

PySpark

Data modelling

CI/CD

Streaming data

English proficiency

Git

Data quality testing

Agentic coding tools awareness

Formação académica

Bachelor's degree in Computer Science, Data Engineering, Data Science, or a related quantitative field

Ferramentas

Databricks

PySpark

Delta Lake

Descrição da oferta de emprego

Anova is hiring a Data Engineer (Databricks) to join our R&D Software team in Porto. This hybrid role blends remote work with occasional in‑office collaboration to build reliable data assets used by reporting, analytics and ML across the company.

You’ll own end‑to‑end Databricks ETL, translate business goals into scalable data solutions, ensure data quality and governance, and collaborate across teams to deliver value with AI-assisted tooling.