Distributed Cloud | GCP Data Engineer

Devoteam; Lisboa; Presencial; EUR 40 000 - 60 000; Tempo integral

Resumo da oferta

Devoteam is seeking a skilled GCP Data Engineer to design and maintain scalable data pipelines using GCP services like BigQuery, Cloud Dataflow, and Cloud Storage. The ideal candidate will have over 3 years of experience in data engineering, a strong proficiency in SQL, and hands-on expertise with GCP data services. Responsibilities include collaborating with Data Scientists for data readiness and automating data infrastructure deployment using Infrastructure as Code tools. Join a diverse team focused on creativity and excellence in data management.

Qualificações

• 3+ years of experience as a Data Engineer, building production-grade data pipelines.
• Hands-on expertise with GCP data services including BigQuery and Cloud Dataflow.
• Strong proficiency in SQL with experience in data warehousing and modeling.

Responsabilidades

• Design and maintain scalable data pipelines using GCP services.
• Collaborate with Data Scientists and Analysts for data readiness.
• Automate deployment and monitoring of data infrastructure using IaC tools.

Conhecimentos

Data pipeline engineering

Google Cloud Platform (GCP)

SQL

Python

Infrastructure as Code (Terraform)

Data modeling

Ferramentas

BigQuery

Cloud Dataflow

Cloud Storage

Cloud Pub/Sub

Docker

Kubernetes

Descrição da oferta de emprego

Job Description

We are seeking an experienced and dedicated GCP Data Engineer to join our team.

• Design, build, and maintain scalable data pipelines and ETL/ELT processes using core GCP data services such as Cloud Dataflow (Apache Beam), Cloud Dataproc, and BigQuery.
• Develop and optimize data infrastructure on GCP to ensure reliable, high-speed data ingestion (e.g., using Cloud Pub/Sub and Cloud Storage).
• Implement data quality checks, monitoring, and validation to ensure accuracy and integrity of data across all GCP systems.
• Collaborate closely with Data Scientists and Data Analysts to ensure data readiness for reporting, analytics, and Machine Learning initiatives (e.g., integrating with Vertex AI).
• Automate deployment, monitoring, and testing of data infrastructure and pipelines using Infrastructure as Code (IaC) tools like Terraform and CI/CD practices.
• Manage and optimize GCP data storage solutions, primarily BigQuery (data warehouse) and Cloud Storage (data lake), for performance and cost efficiency.
• Provide technical guidance and recommendations on data architecture and technology choices within the GCP ecosystem.

Qualifications

• 3+ years of proven experience as a Data Engineer, focusing heavily on building production‑grade data pipelines.
• Mandatory hands‑on expertise with Google Cloud Platform (GCP) data services, including BigQuery, Cloud Dataflow, Cloud Storage, and Cloud Pub/Sub.
• Strong proficiency in SQL and extensive experience with data warehousing concepts and data modeling techniques.
• Expertise in at least one programming language commonly used for data engineering (Python is highly preferred).
• Experience with Infrastructure as Code (IaC) tools like Terraform for automating GCP data infrastructure deployment.
• Solid understanding of distributed systems and ETL/ELT frameworks.
• Excellent analytical and problem‑solving skills, with a passion for continuous learning and data governance.

Preferred Skills

• Google Certified Professional Data Engineer certification.
• Experience with streaming data technologies and real‑time processing within GCP.
• Knowledge of containerization and orchestration (Docker, Kubernetes/GKE).

Additional Information

The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination. We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization. All of our vacancies are open to people with disabilities.