Lead Data Engineer (GCP)

Gft Technologies; Norte; Vor Ort; COP 120.000.000 - 200.000.000; Vollzeit

Zusammenfassung

GFT Technologies is seeking a Senior Data Engineer to lead data integration, ETL, and governance initiatives on a large-scale GCP-driven modernization program.

You will design scalable GCP pipelines using Dataflow, Cloud Functions, and Cloud Run, collaborate with architecture and governance teams, and ensure data quality throughout the lifecycle.

Qualifikationen

• Experience with Google Cloud Platform data services and cloud-native architectures.
• Strong knowledge of data integration and ETL processes.
• Experience building data pipelines with Dataflow, Cloud Functions, or Cloud Run.

Aufgaben

• Lead migration of prebuilt data connectors from legacy systems into the platform's data integration engine.
• Design, develop, and maintain GCP-native data pipelines using Dataflow, Cloud Functions, and Cloud Run.
• Ensure integration of new data sources while maintaining performance, scalability, and reliability.
• Own custom connector deployment and handover after development.
• Maintain continuity of in-flight connector implementations and knowledge transfer.
• Coordinate with Data Architect to align with data lakehouse architecture.
• Collaborate with Data Governance Specialist for data classification and governance.
• Monitor and optimize data ingestion, transformation, and integration processes.
• Support onboarding of new data sources and ensure data quality.
• Document designs, deployment procedures, and configurations for sustainability.

Kenntnisse

GCP

Data integration

ETL processes

Data governance

Data pipelines

Cross-functional collab

Data analysis

Data modeling

Distributed processing

Cloud-native

Tools

Dataflow

Cloud Functions

Cloud Run

Looker

Jobbeschreibung

What We Are Looking For

We are seeking a Senior Data Engineer with strong expertise in Google Cloud Platform (GCP), data integration, ETL processes, and data governance. This role will support a large-scale manufacturing modernization initiative by leading the migration and deployment of data connectors, building scalable GCP-native data pipelines, and ensuring data engineering activities align with enterprise architecture and governance standards. The ideal candidate combines hands-on technical expertise with strong cross-functional collaboration skills in complex, regulated environments.

Responsibilities

• Lead the migration of prebuilt data connectors from legacy customer systems into the platform's data integration engine
• Design, develop, and maintain GCP-native data pipelines using services such as Dataflow, Cloud Functions, and Cloud Run
• Ensure successful integration of new data sources into the platform while maintaining performance, scalability, and reliability
• Take ownership of custom connector deployment and handover activities following the transition from development teams
• Maintain continuity of in-flight connector implementations and support seamless knowledge transfer processes
• Coordinate with the Data Architect to ensure data pipelines and connectors align with the overall data lakehouse architecture
• Collaborate with the Data Governance Specialist to ensure compliance with data classification and governance requirements
• Monitor and optimize data ingestion, transformation, and integration processes
• Support the onboarding of new data sources and ensure data quality throughout the integration lifecycle
• Document designs, deployment procedures, and technical configurations to support long-term platform sustainability
• Contribute to data analysis and modeling initiatives that support business and operational objectives

Requirements and Qualifications

• Experience with Google Cloud Platform (GCP) data services and cloud-native architectures
• Strong knowledge of data integration and ETL processes
• Experience building and managing data pipelines using Dataflow, Cloud Functions, Cloud Run, or similar technologies
• Experience migrating data connectors and integrating data from multiple enterprise systems
• Knowledge of data lakehouse architectures and modern data platforms
• Experience with data analysis and data modeling practices
• Understanding of database technologies and data management principles
• Experience working with large-scale datasets and distributed data processing solutions
• Knowledge of data governance, data quality, and data classification requirements
• Experience collaborating with architecture, engineering, and governance teams
• Strong understanding of cloud-based data engineering best practices

Nice to Have

• Experience supporting manufacturing, industrial, or operational technology environments
• Experience working within regulated environments handling sensitive information
• Knowledge of analytics platforms such as Looker
• Experience with data migration and modernization programs
• Familiarity with AI-enabled platforms and data architectures supporting AI solutions
• Experience supporting multi-workstream and distributed delivery models
• Knowledge of advanced GCP Big Data and Database services

Soft Skills

• Communication
• Problem Solving
• Analytical Thinking
• Collaboration
• Stakeholder Management
• Relationship Building
• Strategic Thinking
• Adaptability
• Proactivity;
• Decision Making
• Self-Management
• Attention to Detail
• Teamwork
• Conflict Resolution

In compliance with our personal data protection policies, we inform you that the information you provide will be processed in accordance with the Privacy Notice available on our website, in the section: Privacy Notice for the Processing of Personal Data – Candidate.