Databricks Data Engineer - Real-Time IoT & BI Pipelines

DataOnline Corp.; Porto; Híbrido; EUR 55 000 - 90 000; Tempo integral

Resumo da oferta

Anova is seeking a Data Engineer (Databricks) to join the R&D Software team in Porto on a hybrid basis. Most work can be done remotely, with occasional in-office time for collaboration.

You will deliver end-to-end Databricks ETL, translate business goals into data solutions, and monitor pipelines in production while ensuring data quality and governance. Leverage AI-assisted coding tools and maintain clear data lineage.

Qualificações

• Bachelor's degree or equivalent in a quantitative field
• 5+ years in data engineering with Databricks experience
• Strong PySpark and Delta Lake understanding
• Solid SQL skills including window functions and joins
• Experience with streaming or incremental ingestion and data modelling
• Familiar with CI/CD for Databricks workflows
• Data quality testing and governance awareness
• Proficient in written and spoken English

Responsabilidades

• Deliver end-to-end Databricks ETL projects from requirements to production
• Translate business goals into data solutions for stakeholders
• Own and monitor data pipelines and ensure reliability
• Build and maintain the One Anova data stream and BI assets
• Work with real-time telemetry from IoT sensors
• Ensure data lineage, governance, and master data quality

Conhecimentos

Databricks

PySpark

Delta Lake

Advanced SQL

Streaming data

CI/CD pipelines

Data modelling

Data quality testing

Code reviews

CI/CD

Formação académica

Bachelor's degree in CS / Data / related field

Ferramentas

Git

Terraform

Descrição da oferta de emprego

Anova is seeking a Data Engineer (Databricks) to join the R&D Software team in Porto on a hybrid basis. Most work can be done remotely, with occasional in-office time for collaboration.

You will deliver end-to-end Databricks ETL, translate business goals into data solutions, and monitor pipelines in production while ensuring data quality and governance. Leverage AI-assisted coding tools and maintain clear data lineage.