Senior Data Engineer - GCP, Pipelines & MLOps

emagine; Lisboa; Híbrido; EUR 55 000 - 90 000; Tempo integral

Resumo da oferta

emagine is seeking a Senior Data Engineer to design, optimize, and operate scalable data platforms in a hybrid environment. You will bridge Data Engineering, DevOps, and MLOps to support data initiatives and analytics.

You’ll implement robust ingestion pipelines, build lakehouse architectures, and promote CI/CD practices using GitHub Actions. Strong GCP and BigQuery skills are essential, as is collaboration with Data Science teams.

Qualificações

• Solid experience in Data Engineering or Software Engineering with large-scale data systems.
• Hands-on experience with Google Cloud Platform (GCP).
• Advanced experience with Google BigQuery and data modelling/best practices.
• Strong understanding of Data Lakes, Lakehouse and layered architectures.
• Designing automated CI/CD pipelines (GitHub Actions).
• Good grasp of DevOps and automated deployment practices.
• Experience building batch and/or streaming data pipelines.
• Professional English proficiency (B2/C1).

Responsabilidades

• Design, develop, monitor, and automate robust data ingestion pipelines for batch and streaming workloads.
• Build integrations with external APIs and third-party data sources, including web scraping.
• Design scalable storage in Google BigQuery with data warehouse best practices.
• Organize data layers from raw ingestion to Publish Layers for analytics.
• Implement and improve CI/CD pipelines ensuring automated deployments.
• Apply software engineering principles to build scalable, secure solutions.
• Support Monorepo workflows enabling collaboration with Data Science teams.
• Assist productionizing Data Science solutions from development to production.
• Contribute to ongoing improvements of the data platform and standards.

Conhecimentos

Data Engineering

Software Engineering

English (B2/C1)

Ferramentas

GCP

BigQuery

Kubernetes

Docker

Datadog

Grafana

Jira

GitHub Actions

VMs

Descrição da oferta de emprego

emagine is seeking a Senior Data Engineer to design, optimize, and operate scalable data platforms in a hybrid environment. You will bridge Data Engineering, DevOps, and MLOps to support data initiatives and analytics.

You’ll implement robust ingestion pipelines, build lakehouse architectures, and promote CI/CD practices using GitHub Actions. Strong GCP and BigQuery skills are essential, as is collaboration with Data Science teams.