Junior Data Engineer — GCP, PySpark & AI (Hybrid)

T-Systems Iberia; La Coruña; Hybrid; EUR 28,000 - 42,000; Full time

Benefits offered by this job

Flexible working hours

Hybrid work model

Health insurance

Meal vouchers

Telemedicine

Life and accident insurance

Social fund

26+ vacation days

Job summary

T-Systems Iberia in Spain is seeking a Junior Data Engineer to join the DBIZ team. You will work on data ingestion and data products on ODE, deploying infrastructure on GCP and building data pipelines with Hive, PySpark, Airflow, and Terraform.

You'll implement Python applications, manage CI/CD with GitLab, and ensure security via IAM and Secret Manager while integrating data from CDI, FTP endpoints, TARDIS API and GCS. Hybrid on-site/work flexibility is offered.

Qualifications

• Experience with Google Cloud Platform (GCP) services.
• Proficient in Python programming.
• Experience with Terraform for infra as code.
• Knowledge of Hive, PySpark and Airflow.
• Experience with CI/CD pipelines, preferably GitLab.
• Familiar with data ingestion and data integration.
• GCP Cloud Architect or Data Engineer certs desirable.

Responsibilities

• Infrastructure Deployment & Management on GCP.
• Data processing with Hive, PySpark.
• Orchestrate jobs with Airflow.
• Manage GKE, Cloud Run, BigQuery, Compute Engine, Composer via Terraform.
• Develop Python applications for GCP services.
• Implement CI/CD pipelines with GitLab Magenta.
• Ensure security via IAM, Secrets, and policies.
• Integrate data sources from CDI, FTP, TARDIS, and GCS.
• Deploy across DEV/TEST/PROD environments.
• Explore AI with Vertex AI.

Skills

GCP

Terraform

Python

GitLab CI/CD

Airflow

Hive

PySpark

Data integration

Tools

GKE

Cloud Run

BigQuery

Compute Engine

Composer

Job description

T-Systems Iberia in Spain is seeking a Junior Data Engineer to join the DBIZ team. You will work on data ingestion and data products on ODE, deploying infrastructure on GCP and building data pipelines with Hive, PySpark, Airflow, and Terraform.

You'll implement Python applications, manage CI/CD with GitLab, and ensure security via IAM and Secret Manager while integrating data from CDI, FTP endpoints, TARDIS API and GCS. Hybrid on-site/work flexibility is offered.