Data Engineer - ERP & Enterprise Data Lake Integrations

InnoWave; Lisboa; Presencial; EUR 50 000 - 70 000; Tempo integral

Resumo da oferta

InnoWave in Lisbon is seeking a Data Engineer to join our Data Office team and support ERP and enterprise applications integration into the Data Lake. You will design, develop and maintain data pipelines, implement ETL/ELT with Databricks, ensure data quality and availability for analytics, and work closely with Business Analysts and Data Governance to meet requirements.

Fluent in English and capable of collaborating across functional teams, you will contribute to scalable Data Lake

Qualificações

• Degree in Computer Science or in similar areas.
• Strong hands-on Data Engineering experience.
• Strong SQL skills.
• Experience developing ETL/ELT pipelines.
• Experience with Databricks and/or Spark/PySpark.
• Experience integrating data from relational databases and enterprise applications.
• Experience with APIs, batch/file-based integrations and database ingestion.
• Good understanding of Data Lake / Lakehouse architectures.
• Experience with data transformation, mapping, validation and reconciliation.
• Experience with pipeline orchestration and monitoring.
• Ability to troubleshoot data quality and integration issues.
• Experience working with Git and standard software/data engineering development practices.
• Fluent in English - written and spoken (mandatory).

Responsabilidades

• Designing, developing and maintaining reliable data pipelines, transforming source-system data into standardized data models, and ensuring data quality and availability for downstream analytics, reporting and business applications.
• Translate defined data requirements and mappings into robust technical implementations.
• Design and implement data ingestion pipelines from ERP and other enterprise applications into the Data Lake.
• Develop ETL/ELT pipelines using Databricks and related data engineering technologies. Extract data from SQL databases, APIs, files and other enterprise data sources. Implement data transformations, mappings and business rules defined with business and application teams.
• Build and maintain structured Data Lake / Lakehouse data models.
• Implement incremental loads, orchestration, scheduling and dependency management.
• Develop data quality, validation and reconciliation controls across source and target systems.
• Troubleshoot data integration and pipeline issues.
• Monitor pipeline performance, reliability and data freshness.
• Document data flows, mappings, transformations and technical dependencies.
• Work closely with Business Analysts and Data Governance teams to ensure technical implementations meet business and governance requirements.

Conhecimentos

Strong SQL skills

Hands-on data engineering

ETL/ELT pipelines

Databricks / Spark / PySpark

Data integration from ERP

APIs and batch ingestion

Data Lake / Lakehouse

Data quality and validation

Pipeline orchestration and monitoring

Git and software development practices

English fluent

Formação académica

Degree in Computer Science or similar

Ferramentas

Databricks

Spark/PySpark

SQL databases

APIs

Descrição da oferta de emprego

InnoWave in Lisbon is seeking a Data Engineer to join our Data Office team and support ERP and enterprise applications integration into the Data Lake. You will design, develop and maintain data pipelines, implement ETL/ELT with Databricks, ensure data quality and availability for analytics, and work closely with Business Analysts and Data Governance to meet requirements.

Fluent in English and capable of collaborating across functional teams, you will contribute to scalable Data Lake