GCP Data Platform Engineer: Automation & Analytics

Jobtailor; Dearborn (MO); On-site; USD 100,000 - 130,000; Full time

Job summary

Jobtailor in Dearborn, Missouri is seeking a data engineer to automate pipelines and build scalable analytics platforms on GCP. You will organize massive datasets, work with architects to productionalize pipelines, and translate business needs into technical requirements.

The role emphasizes data products, streaming and batch ingestion, and expertise in GCP services and Terraform. Strong communication and collaboration with product teams are essential.

Qualifications

• Master’s degree in Computer Science or related field with 5 years of related experience.
• 5 years SQL development for analyzing and integrating large datasets across data sources.
• 5 years analytics and data product development translating business problems to data requirements.
• 3 years GCP experience with production-scale solutions.
• 2 years GCP native services including BigQuery, GCS, Pub/Sub, Dataflow, Dataproc, Cloud Build.
• 2 years Airflow for scheduling and orchestration of data pipelines.
• 2 years Terraform for Infrastructure as Code.
• 2 years Java or Python for cloud run functions and event-driven processing.

Responsibilities

• Implement methods to automate pipeline stages, reducing manual labor in development and production.
• Analyze complex data, organize raw data, and integrate large datasets into analytical domains.
• Collaborate with architects to productionalize data ingestion, curation, and consumption pipelines.
• Translate business problems into technical data requirements with product management alignment.
• Develop analytical data products using streaming and batch ingestion on Google Cloud Platform.
• Serve as Subject Matter Expert in Data Engineering focusing on GCP native services and related technologies.

Skills

SQL Development

data analysis

data integration

data product development

data ingestion

data curation

data consumption

cloud development

Infrastructure as Code

event-driven programming

Education

Master’s degree in Computer Science

Tools

BigQuery

Google Cloud Storage

Pub/Sub

Dataflow

Dataproc

Cloud Build

Airflow

Terraform

Java

Python

Job description

Jobtailor in Dearborn, Missouri is seeking a data engineer to automate pipelines and build scalable analytics platforms on GCP. You will organize massive datasets, work with architects to productionalize pipelines, and translate business needs into technical requirements.

The role emphasizes data products, streaming and batch ingestion, and expertise in GCP services and Terraform. Strong communication and collaboration with product teams are essential.