GCP Engineer

Insight Global; Dearborn (MI); Presencial; USD 83.000 - 90.000; Jornada completa

Descripción de la vacante

Insight Global is seeking an experienced Data Engineer to join our automotive client’s data team. You will design and deploy scalable data pipelines in Google Cloud Platform, moving data from on-prem systems to GCP using Airflow and BigQuery.

Responsibilities include building data models, ensuring data quality, IAM governance, and setting up monitoring and logging for production pipelines; prior experience with GCP services is essential.

Formación

• The Data Engineer will join our automotive client’s team working in one of the world’s largest data lakes.
• Move data from on-prem to GCP using Airflow and BigQuery.
• Strong data modeling, integration, and governance skills.

Responsabilidades

• Build data pipelines with Airflow on GCP.
• Migrate on-prem data to Google Cloud environment.
• Design scalable data models and ensure data quality.
• Set up monitoring, logging, and IAM governance for production pipelines.

Conocimientos

Data pipelines

GCP

BigQuery

Airflow

Cloud Run/Functions

Pub/Sub

IAM Monitoring

Certification: Data Eng

Descripción del empleo

Job Description

• 10+ years of experience as Data Engineer


• Experience developing data pipelines


• Data Engineering Certification


• Cloud Data Engineering Certification


• Cloud Architecture Certification


• Strong experience working in Google Cloud Platform (GCP)


• Development in Cloud Run/Cloud Function, Pub/Sub Integration


• BigQuery development/operations


• IAM, Cloud Logging, Monitoring principles, operations

Skills and Requirements

The Data Engineer will join our automotive client’s team working in one of the world’s largest data lakes. This team’s current goal is to move their data from on-prem to GCP by utilizing Airflow and BigQuery. You will work with on-prem data sources (Hadoop, SQL Server, Teradata, etc.), understand the data model & business rules behind the data, and build data pipelines (with GCP) using Airflow for workflows and pipeline management. You will also partner with IT source teams to ingest data from various sources into a big data environment and streamline data ingestion processes. This data will be landed in GCP BigQuery.

Compensation:$60-$65Exact compensation may vary based on several factors, including skills, experience, and education.

Benefit packages for this role will start on the 1st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal employment opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment without regard to race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request to [e-mail].