Data Engineer (M/F/D)

T-Systems; País Vasco; Híbrido; EUR 32.000 - 42.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid work model (remote/on-site)

Flexible working hours

Health Insurance

Meal vouchers

Telemedicine

Descripción de la vacante

T-Systems in Spain (DBIZ team) is seeking a Junior Data Engineer to join our dynamic data platform. You will help deploy and manage cloud infrastructure on GCP, develop data products, and operate data pipelines across DEV/TEST/PROD environments.

You will work with SQL/NoSQL data stores, and build Python-based applications for cloud services.

Formación

• Familiarity with Google Cloud Platform (GCP).
• Familiarity with Terraform for infrastructure management.
• Python programming for application implementation.
• Familiarity with GitLab CI/CD for automation.
• Familiarity with network architectures, security implementations, and management of core GCP services.
• Knowledge in employing data processing tools like Hive, PySpark, and data orchestration tools like Airflow.
• Familiarity with managing and integrating diverse data sources.
• Certified GCP Cloud Architect and Data Engineer would be beneficial.

Responsabilidades

• Infrastructure Deployment & Management on Google Cloud Platform (GCP).
• Data Processing & Transformation using Hadoop Hive and PySpark; Airflow for orchestration.
• Core GCP services management (GKE, Cloud Run, BigQuery, Compute Engine, Composer) via Terraform.
• Develop and implement Python applications for GCP services.
• CI/CD pipelines with GitLab Magenta for deployment, testing, and configuration of data pipelines.
• Security & Compliance: IAM, Secret Manager, firewalls, identity-aware policies.
• Data integration from CDI, Datendrehscheibe, TARDIS APIs and Google Cloud Storage.

Conocimientos

GCP infrastructure

Python programming

Terraform

GitLab CI/CD

Airflow

Hive & PySpark

Data ingestion & processing

Cloud services (GKE, Cloud Run, BigSQL

Herramientas

Terraform

GitLab CI/CD

GCP services (GKE, Cloud Run, BigQuery)

Airflow

Hive

PySpark

Descripción del empleo

Job Description We are looking for a skilled Junior Data Engineer to join our team in DBIZ. The Technik Value Stream teams are responsible for Data Ingest on ODE, development of the relevant data products on ODE, and Operations of the data products on ODE.

Your Task

We are looking for a skilled Junior Data Engineer to join our team in DBIZ. The Technik Value Stream teams are responsible for Data Ingest on ODE, development of the relevant data products on ODE, and Operations of the data products on ODE.

Responsibilities

• Infrastructure Deployment & Management: Efficiently deploy and manage infrastructure on Google Cloud Platform (GCP) including network architectures (Shared VPC, Hub-and-Spoke), security implementations (IAM, Secret Manager, firewalls, Identity-Aware Proxy), DNS configuration, VPN, and Load Balancing.
• Data Processing & Transformation: Utilize Hadoop cluster with Hive for querying data, and PySpark for data transformations. Implement job orchestration using Airflow.
• Core GCP Services Management: Work extensively with services like Google Kubernetes Engine (GKE), Cloud Run, BigQuery, Compute Engine, and Composer, all managed through Terraform.
• Application Implementation: Develop and implement Python applications for various GCP services.
• CI/CD Pipelines: Integrate and manage GitLab Magenta CI/CD pipelines for automating cloud deployment, testing, and configuration of diverse data pipelines.
• Security & Compliance: Implement comprehensive security measures, manage IAM policies, secrets using Secret Manager, and enforce identity-aware policies.
• Data Integration: Handle integration of data sources from CDI, Datendrehscheibe (FTP servers), TARDIS API's and Google Cloud Storage (GCS).
• Multi-environment Deployment: Create and deploy workloads across Development (DEV), Testing (TEST), and Production (PROD) environments.
• AI Solutions: Implement AI solutions using Google's Vertex AI for building and deploying machine learning models.

Your Profile

We are looking for a skilled Junior Data Engineer with strong expertise in Google Cloud Platform infrastructure, data processing technologies, and automation tools to join our team in DBIZ.

Must Have Skills

• Familiarity with Google Cloud Platform (GCP)
• Familiarity with Terraform for infrastructure management
• Python programming for application implementation
• Familiarity with GitLab CI/CD for automation
• Familiarity with network architectures and security implementations
• Familiarity with management of core GCP services
• Knowledge in employing data processing tools like Hive and PySpark
• Knowledge in data orchestration tools like Airflow
• Familiarity with managing and integrating diverse data sources

Nice to Have Skills

• Certified GCP Cloud Architect
• Certified GCP Data Engineer

Qualifications

Skills Required

• Familiarity with GCP.
• Familiarity with Terraform for infrastructure management.
• Python for application implementation.
• Familiarity with GitLab CI/CD for automation.
• Familiarity with network architectures, security implementations, and management of core GCP services.
• Knowledge in employing data processing tools like Hive, PySpark, and data orchestration tools like Airflow.
• Familiarity with managing and integrating diverse data sources.
• Certified GCP Cloud Architect and Data Engineer would be beneficial.

Additional Information

What do we offer you?

Work environment & flexibility

• International, dynamic and collaborative environment.
• T-Social: social initiatives (sports, community, health, ...).
• Hybrid work model (remote/on-site).
• Flexible working hours.

Growth & development

• Customized training: access to Coursera to learn whatever you want, whenever you want.
• Weekly language classes (English & German).
• International Mentoring Sessions & Experience Days.

Compensation & benefits

• Flexible compensation plan (health insurance, meal vouchers, childcare, transport).
• Telemedicine.
• Life and accident insurance.
• Social fund.

Wellbeing & time off

• 26+ working days of vacation per year.
• Free access to specialist services (medical, legal, wellness).
• 100% salary coverage during medical leave.
• And many more advantages of being part of T-Systems!