Data Engineer

Orcapod Consulting Services; Bengaluru; Hybrid; INR 800,000 - 1,500,000; Full time

Job summary

Orcapod Consulting Services is seeking a skilled data engineer to build and maintain data pipelines using GCP services like BigQuery and Dataflow. The ideal candidate possesses strong experience in cloud-based data engineering and proficiency in SQL and Python.

The position involves collaborating with data scientists to optimize ETL workflows for analytics and AI applications. Knowledge of Docker and Kubernetes is a plus. Working remotely is an option.

Qualifications

• Degree in Computer Science, Engineering, IT, or a related field.
• GCP certifications are a plus.
• Strong experience in cloud-based data engineering.

Responsibilities

• Build and maintain robust data pipelines using GCP.
• Develop and optimize ETL/ELT workflows for analytics and AI.
• Collaborate with data scientists to ensure data quality.

Skills

Cloud-based data engineering

Real-time data processing

SQL

Python

Apache Beam

Spark

GCP services (BigQuery, Pub/Sub, Dataflow)

ETL/ELT

Data modeling

Data governance

CI/CD

Infrastructure automation tools

Education

Degree in Computer Science, Engineering, IT, or related field

Tools

Docker

Kubernetes

Airflow

Cloud Composer

Job description

Key Responsibilities

• Build and maintain robust data pipelines using GCP services such as BigQuery, Pub/Sub, Dataflow, and Cloud Storage.
• Develop and optimize ETL/ELT workflows for analytics and AI applications.
• Collaborate with data scientists and AI engineers to ensure data quality, availability, and governance.
• Automate workflows and support CI/CD for data infrastructure.
• Monitor, troubleshoot, and optimize data systems and performance.

Required Skills

• Strong experience in cloud-based data engineering and real-time data processing.
• Proficiency in SQL, Python, Apache Beam, or Spark.
• Hands-on experience with GCP services like BigQuery, Pub/Sub, Dataflow, and IAM.
• Good understanding of ETL/ELT, data modeling, and data governance.
• Experience with CI/CD and infrastructure automation tools.

Nice to Have

• Experience with AI/ML or agentic AI integrations.
• Knowledge of Docker, Kubernetes, Airflow, or Cloud Composer.
• Exposure to shipping, logistics, or financial market domains.

Qualifications

• Degree in Computer Science, Engineering, IT, or related field.
• GCP certifications are a plus.

Location: Open

Travel Required: No