GCP Data Engineer: Build Scalable Data Pipelines & Lakes

HTC Global Services; Dearborn (MI); On-site; USD 110,000 - 160,000; Full time

Job summary

HTC Global Services is seeking a Data Engineer with experience designing, building, and maintaining scalable data solutions on Google Cloud Platform (GCP). You will develop data infrastructure, pipelines, and platforms to support data collection, storage, processing, and analytics.

The ideal candidate has experience with GCP and cloud-based data solutions. Responsibilities include collaborating with stakeholders, designing data infrastructure, and maintaining data warehouses, data lakes, and

Qualifications

• Bachelor's or Master's degree required.
• 4+ years of Data Engineering experience.
• Experience with Data Warehousing and Data Modeling.
• Experience with Google Cloud Platform (GCP) services, including BigQuery.
• Experience with data ingestion and transformation.
• Experience with QlikView, Cloud Functions, Data Fusion, Astronomer, and Apache Airflow.
• Knowledge of AI-assisted development tools and AI concepts.

Responsibilities

• Collaborate with business and technology stakeholders to understand current and future data requirements.
• Design, build, and maintain reliable, scalable data infrastructure for data collection, storage, transformation, and analysis.
• Develop and maintain scalable data pipelines, data models, and applications to support reliable data workflows.
• Design, implement, and maintain data platforms, including data warehouses, data lakes, and data lakehouse environments for structured and unstructured data.
• Develop analytical tools, scripts, algorithms, and automation to support data engineering activities.
• Monitor data platform performance and identify opportunities for optimization and improvement.
• Perform data ingestion, data wrangling, and data transformation for various data sources, including loading data into BigQuery.
• Develop and maintain stored procedures, triggers, and data models.
• Work with QlikView, Cloud Functions, Data Fusion, Astronomer, and Apache Airflow.

Skills

4+ years of Data Engineering

Data Warehousing

Data Modeling

AI-assisted development tools

AI concepts and multi-agent systems

SDLC integration of AI tools

Education

Bachelor's or Master's degree

Tools

QlikView

Cloud Functions

Data Fusion

Astronomer

Apache Airflow

Vertex AI

Gemini Code Assist

OpenCode

GitHub Copilot

BigQuery

Job description

HTC Global Services is seeking a Data Engineer with experience designing, building, and maintaining scalable data solutions on Google Cloud Platform (GCP). You will develop data infrastructure, pipelines, and platforms to support data collection, storage, processing, and analytics.

The ideal candidate has experience with GCP and cloud-based data solutions. Responsibilities include collaborating with stakeholders, designing data infrastructure, and maintaining data warehouses, data lakes, and