Junior Data Engineer

Innowave Group; Lisboa; Presencial; EUR 32 000 - 46 000; Tempo integral

Resumo da oferta

InnoWave in Lisbon is seeking a Junior Data Engineer to join our team. You will develop and maintain data ingestion and transformation pipelines from ERP and other enterprise sources into the Data Lake, using SQL, Python, and Databricks.

The role requires up to 3 years in data engineering, strong SQL, and fluent English. You will collaborate with analysts and application teams in an international environment while following our data security and quality standards.

Qualificações

• Degree in Computer Engineering, Computer Science, Electronic Engineering, or a related field.
• Up to 3 years of experience in Data Engineering.
• Strong knowledge of SQL.
• Basic to intermediate Python programming.
• Understanding of relational databases and data processing concepts.
• Familiarity with ETL/ELT processes and data pipeline fundamentals.
• Basic understanding of data ingestion, transformation, and data quality concepts.
• Familiarity with Git and version control practices.
• Ability to analyse data and troubleshoot technical issues.
• Good analytical and problem-solving skills.
• Good communication skills and ability to work collaboratively in an international environment.
• Fluent in English - written and spoken (mandatory).

Responsabilidades

• Develop and maintain data ingestion and transformation pipelines into the Data Lake.
• Build ETL/ELT processes using SQL, Python, Databricks.
• Extract data from relational databases, APIs, files, and other sources.
• Implement data transformations, mappings, and business rules.
• Support the development of Data Lake / Lakehouse data models.
• Implement incremental data loads and pipeline orchestration.
• Develop data quality checks and reconciliation processes.
• Troubleshoot data integration, transformation, and pipeline issues.
• Monitor pipeline execution, data availability, and data freshness.
• Document data flows, mappings, transformations, and dependencies.
• Collaborate with Analysts and governance stakeholders.
• Follow established standards for code quality, testing, and data security.

Conhecimentos

SQL

Python

Data pipelines

Git

Analytical thinking

English fluency

Formação académica

Degree in Computer Engineering/CS/EE

Ferramentas

Databricks

APIs

ETL/ELT

Descrição da oferta de emprego

InnoWave is looking for a dynamic, agile person, good communication skills to complete our team. If you're based in Lisbon, this might be the opportunity for you!

Junior Data Engineer

Responsibilities

• Develop and maintain data ingestion and transformation pipelines from ERP and other enterprise applications into the Data Lake.
• Build ETL/ELT processes using SQL, Python, Databricks, and related data engineering technologies.
• Extract and process data from relational databases, APIs, files, and other enterprise data sources.
• Implement data transformations, mappings, and business rules based on specifications provided by business and application teams.
• Support the development and maintenance of structured Data Lake / Lakehouse data models.
• Implement and maintain incremental data loads, pipeline scheduling, and orchestration under the guidance of senior team members.
• Develop and execute data quality checks, validation rules, and reconciliation processes.
• Investigate and troubleshoot data integration, transformation, and pipeline execution issues.
• Monitor pipeline execution, data availability, and data freshness.
• Document data flows, mappings, transformations, and technical dependencies.
• Collaborate with Business Analysts, application teams, and Data Governance stakeholders to ensure data requirements are correctly implemented.
• Follow established standards for code quality, version control, testing, and data security.

Skills

• Degree in Computer Engineering, Computer Science, Electronic Engineering, or a related field.
• Up to 3 years of experience in Data Engineering.
• Good knowledge of SQL.
• Basic to intermediate Python programming skills.
• Understanding of relational databases, data structures, and data processing concepts.
• Familiarity with ETL/ELT processes and data pipeline fundamentals.
• Basic understanding of data ingestion, transformation, and data quality concepts.
• Familiarity with Git and version control practices.
• Ability to analyse data, identify inconsistencies, and troubleshoot technical issues.
• Good analytical and problem-solving skills.
• Good communication skills and ability to work collaboratively in an international environment.
• Fluent in English - written and spoken (mandatory).

InnoWave gives equal opportunity in employment regardless of gender, gender identity, sexual orientation, marital status, race, nationality, religion, age, disability, political beliefs, or any other factor. InnoWave will not pay fees to any third-party agency or company that does not have a signed agreement, do not submit resumes/CV's directly.