GCP Data Platform Engineer — Microservices & Real-Time Pipelines

Jobtailor; Dearborn (MO); On-site; USD 120,000 - 160,000; Full time

Job summary

Jobtailor is seeking a data architect to design, implement, and operate scalable data pipelines and microservices on Google Cloud Platform. The role emphasizes real-time and batch processing, data governance, and security across the data platform.

You will collaborate with data architects and software engineers to standardize data for analytics, integrate diverse data sources, and enhance system performance and reliability across front-end and back-end components.

Qualifications

• Bachelor’s degree or foreign equivalent in software, electrical, computer, or related engineering field.
• 3 years of experience in the job offered or related occupation.
• 3 years of experience utilizing GitHub for source code management.
• 1 year of experience integrating front-end and back-end components.
• 1 year of experience utilizing container technologies to deploy services.
• 1 year of experience automating processes to improve reliability and efficiency.
• Must be legally authorized to work in the United States.
• Must live within a reasonable commuting distance from the Dearborn worksite.

Responsibilities

• Architect, develop, and maintain scalable data pipelines and microservices on GCP for real-time and batch processing.
• Design and implement service-oriented and microservices-based architectures.
• Integrate front-end and back-end components for robust data access and UI-driven data exploration.
• Lead ingestion and integration of data from various sources into the data platform.
• Standardize and optimize data for analytics.
• Utilize GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Functions to build and manage data platforms.
• Implement and manage data governance, access controls, and security best practices.
• Leverage GCP row- and column-level security features.
• Monitor and improve performance, scalability, and efficiency of data pipelines and storage solutions.
• Collaborate with data architects, software engineers, and cross-functional teams to define best practices, design patterns, and frameworks.
• Automate data platform processes to improve reliability and reduce manual intervention.

Skills

GCP Data Pipeline Development

Microservices Architecture

Data Governance Implementation

GitHub Source Code Management

Container Technologies

Education

Bachelor's degree in Software Engineering / Computer Engineering / related field

Tools

GitHub

GCP

Job description

Jobtailor is seeking a data architect to design, implement, and operate scalable data pipelines and microservices on Google Cloud Platform. The role emphasizes real-time and batch processing, data governance, and security across the data platform.

You will collaborate with data architects and software engineers to standardize data for analytics, integrate diverse data sources, and enhance system performance and reliability across front-end and back-end components.