GCP Data Engineer

Miracle Software Systems, Inc.

India

On-site

INR 1,500,000 - 2,500,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Miracle Software Systems, Inc. is seeking a data engineering professional to translate complex system data into business-friendly models and AI-ready datasets on Google Cloud Platform.

You will build data orchestration, serving, and API integration layers using Python, REST APIs, and cloud services. Responsibilities include developing batch and streaming pipelines with Dataflow and Pub/Sub for real-time processing, implementing CI/CD with GitHub Actions, automating infrastructure with Terraform,

Responsibilities

  • Translate complex system data into business-friendly entities and semantic models for AI-ready datasets.
  • Build and maintain data orchestration, serving, and API integration layers using Python, REST APIs, and cloud services.
  • Develop batch and streaming data pipelines with Google Cloud Dataflow and Google Pub/Sub for real-time data processing.
  • Implement CI/CD pipelines with GitHub Actions, automate infrastructure provisioning with Terraform, and manage Git branching across development, staging, and production environments.
  • Discover, prepare, validate, and integrate structured and unstructured datasets for MVP development and production use within enterprise data platforms.
  • Integrate Vertex AI and support Generative AI, Agentic AI, RAG, AI grounding, tool calling, and long-term memory requirements through appropriate data structures and integrations.
  • Maintain data dictionaries, metadata documentation, governance practices, data quality, and observability to support reliable data access and AI grounding.

Job description

  • Translate complex system data into business-friendly entities and semantic models, preparing AI-ready datasets and presentation-ready data products within GCP.
  • Build and maintain data orchestration, serving, and API integration layers using Python, REST APIs, and cloud services.
  • Develop and maintain batch and streaming data pipelines using Google Cloud Dataflow and Google Pub/Sub for real-time messaging and data processing.
  • Implement CI/CD pipelines using GitHub Actions, automate infrastructure provisioning with Terraform, and maintain Git branching strategies across development, staging, and production environments.
  • Discover, prepare, validate, and integrate structured and unstructured datasets for MVP development and production use within enterprise data platforms.
  • Integrate Vertex AI and support Generative AI, Agentic AI, RAG, AI grounding, tool calling, and long-term memory requirements through appropriate data structures and integrations.
  • Maintain data dictionaries, metadata documentation, governance practices, data quality, and observability to support reliable data access and AI grounding.
  • Participate in discovery sessions and prototyping, collaborating with cross-functional teams to map customer journeys, define data requirements, and develop suitable technical solutions.

Applicants are considered for employment without attention to or discrimination against race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. All employment is decided on the basis of qualifications, merit and business need.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Ford Motor • Chennai

On-site
INR 1,200,000 - 2,000,000
GCP Data Engineer
GCP Data Engineer

ValueLabs • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Data Engineer with GCP
Data Engineer with GCP

Luxoft • Bengaluru

On-site
INR 4,000,000 - 6,000,000
Data Engineer
Data Engineer

Mancer Consulting Services • Hyderabad

On-site
INR 1,000,000 - 2,000,000
Data Engineer - GCP, SQL,BiqQuery, Dataflow, Pub/Sub, Logging, IAM
Data Engineer - GCP, SQL,BiqQuery, Dataflow, Pub/Sub, Logging, IAM

United Parcel Service, Inc. • Chennai District

On-site
INR 1,200,000 - 1,800,000
Data Engineer
Data Engineer

Google • Bengaluru

On-site
INR 1,800,000 - 3,200,000
Gcp Data Engineer
Gcp Data Engineer

LTM • Hyderabad

On-site
INR 1,200,000 - 2,500,000
Data Engineer
Data Engineer

LS Digital Group • Navi Mumbai

On-site
INR 1,200,000 - 1,600,000
Gcp Data Engineer
Gcp Data Engineer

Tata Elxsi, Inc. • Hyderabad, Chennai, Bengaluru

On-site
INR 1,800,000 - 2,600,000
Gcp Data Engineer
Gcp Data Engineer

Altimetrik • Chennai District

On-site
INR 900,000 - 1,800,000