GCP Data Engineer: Scalable Pipelines & Data Lakehouse

HTC Global Services; Dearborn (MI); Hybride; USD 100 000 - 170 000; Plein temps

Résumé du poste

HTC Global Services is seeking an experienced Full Stack Data Engineer to design, build, and optimize scalable data pipelines and solutions in a Google Cloud Platform environment. You will collaborate with business and technology stakeholders to define data requirements and deliver end-to-end data infrastructure, including data warehouses, lakes, and lakehouse solutions.

The role requires 5–7 years in data or software engineering, strong SQL/Java/Python skills, and hands-on GCP experience with

Qualifications

• Bachelor's degree or equivalent in CS/IT/IS/Data Analytics or related field.
• 5–7 years of experience in Data Engineering or Software Engineering.
• At least 2 years of hands-on experience building and deploying cloud-based data platforms.
• Strong proficiency in SQL, Java, and Python.
• Experience with GCP services such as BigQuery, Dataflow, DataProc, Pub/Sub, and Cloud Functions.
• Familiarity with Terraform and Tekton; experience with CI/CD and IaC.
• Experience with relational (PostgreSQL, MySQL) and NoSQL/columnar databases (BigQuery).
• Experience with data governance, encryption, and data masking in the cloud.
• Experience with data/analytics dashboards and cost/resource optimization for GCP.

Responsabilités

• Collaborate with stakeholders to define data requirements.
• Design, build, and maintain scalable data infrastructure for data collection, storage, transformation, and analysis.
• Develop data pipelines, models, and applications for reliable data workflows.
• Create and maintain data warehouses, data lakes, and lakehouse solutions for structured and unstructured data.
• Develop analytical tools, algorithms, and programs for data engineering tasks.
• Automate data platform tasks and processes.
• Ingest and curate data from diverse sources with quality controls.
• Ensure data is standardized and optimized for analytics.
• Contribute to end-to-end data flow from source to insight.
• Manage data platforms using GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Functions).
• Implement data governance, access controls, and security best practices.
• Support data security with GCP-native features, encryption, and masking.
• Monitor and optimize performance, cost, and resources of data pipelines.

Connaissances

SQL

Java

Python

Data engineering

Analytical thinking

Troubleshooting

Formation

Bachelor's degree in CS/IT/IS/Data Analytics

Master's degree preferred

Outils

BigQuery

Dataflow

DataProc

Pub/Sub

Cloud Functions

Astronomer

Terraform

Dataform

Description du poste

HTC Global Services is seeking an experienced Full Stack Data Engineer to design, build, and optimize scalable data pipelines and solutions in a Google Cloud Platform environment. You will collaborate with business and technology stakeholders to define data requirements and deliver end-to-end data infrastructure, including data warehouses, lakes, and lakehouse solutions.

The role requires 5–7 years in data or software engineering, strong SQL/Java/Python skills, and hands-on GCP experience with