Senior Data Engineer - Google Cloud

OSI Digital, Inc.; Hyderabad; Remote; INR 2,066,000 - 3,444,000; Part time

Job summary

OSI Digital, Inc. seeks a senior GCP Data Engineer Solution Architect for a 3-month, part-time contract. You will lead hands-on data engineering on Google Cloud, combine architecture work with business analysis, and deliver end-to-end target designs with stakeholders.

This remote role runs about 20 hours per week. You will assess current data landscapes, design target solutions, write code where needed, and collaborate with internal teams to ensure scalable, secure data platforms on GCP.

Qualifications

• 8-10 years of experience in data engineering or analytics.
• At least 4 years hands-on experience with Google Cloud Platform.
• Strong experience with GCP data services: BigQuery, Dataflow, Dataproc, Cloud Composer, Cloud Storage, Pub/Sub, IAM.
• Expert-level Python and SQL, with PySpark experience.
• Proven solution architecture for end-to-end data platforms and integration patterns.
• Experience with CI/CD, Git and infrastructure-as-code (Terraform preferred).
• Excellent communication and documentation; comfortable with remote stakeholders.

Responsibilities

• Gather business and technical requirements and translate into solution designs.
• Perform gap analyses between current and target data landscapes and propose remediation options.
• Define data ingestion, processing, storage and consumption architectures on GCP.
• Design and build scalable data pipelines using GCP tools.
• Write production-quality code in Python, PySpark and SQL for data transformation.
• Model data using dimensional, data vault or lakehouse patterns and optimize BigQuery costs.
• Prepare architecture diagrams, design docs and handover materials.
• Review code and designs and advise on best practices for GCP data engineering.
• Report progress, risks and dependencies to stakeholders.

Skills

Data engineering

GCP expertise

Python

SQL

PySpark

Business analysis

CI/CD

Stakeholder management

Documentation

Remote work

Tools

BigQuery

Dataflow

Dataproc

Cloud Composer (Airflow)

Cloud Storage

Pub/Sub

IAM

Job description

Job Title: GCP Data Engineer Solution Architect (Contract)
Engagement Type: Contract, part-time
Duration: 3 months (extension possible)
Experience: 8-10 years
Work Mode: Remote work from home
Commitment: 20 hours per week

About the Role

We need a senior data professional on a short-term, part-time contract. You'll combine hands‑on data engineering on Google Cloud Platform with solution architecture and business analysis. You'll assess the current state, find gaps, design the target solution and write code where needed, working mostly on your own with our internal team and stakeholders.

Key Responsibilities

• Gather business and technical requirements through stakeholder workshops and turn them into solution designs.
• Do gap analysis between the current-state data landscape and the target-state requirements, then recommend remediation options and a roadmap.
• Define the solution architecture for data ingestion, processing, storage and consumption layers on GCP.
• Design and build scalable data pipelines using BigQuery, Dataflow, Dataproc, Cloud Composer (Airflow), Cloud Storage and Pub/Sub.
• Write production-quality code in Python, PySpark and SQL for data transformation, data quality checks and automation.
• Design data models (dimensional, data vault or lakehouse patterns) and optimize BigQuery performance and cost.
• Prepare architecture diagrams, design documents, gap analysis reports and handover documentation.
• Review code and designs, and advise the internal team on best practices for GCP data engineering.
• Report progress, risks and dependencies to project stakeholders regularly.

Required Skills & Qualifications

1. 8-10 years of experience in data engineering, data platforms or analytics, with at least 4 years of hands‑on work on GCP.
2. Strong experience with GCP data services: BigQuery, Dataflow, Dataproc, Cloud Composer, Cloud Storage, Pub/Sub, IAM.
3. Expert‑level Python and SQL, with solid hands‑on experience in PySpark.
4. Proven solution architecture experience: designing end‑to‑end data platforms, integration patterns and non‑functional requirements (security, scalability, cost).
5. Strong business analysis skills: requirement elicitation, process mapping, BRDs/FRDs and gap analysis.
6. Experience with CI/CD, Git and infrastructure-as-code (Terraform preferred).
7. Excellent communication and documentation skills; comfortable working with both business and technical stakeholders.
8. Self‑driven and able to deliver independently in a remote, part‑time setting.

Good to Have

• Google Cloud Professional Data Engineer or Professional Cloud Architect certification.
• Exposure to other cloud platforms (AWS, Azure) or to Snowflake or Databricks.
• Experience with data governance tools (Dataplex, Data Catalog) and data quality frameworks.
• Domain experience in BFSI, aviation, telecom or the public sector.