Data Engineer

VRINDA INTERNATIONAL; Maharashtra; On-site; INR 3,500,000 - 7,200,000; Full time

Job summary

Vrinda International is seeking an experienced Data Engineer to architect and maintain scalable data infrastructure in India. You will drive data warehousing design, modeling, and cloud-native pipelines using Google Cloud technologies to enable data-driven decisions and operational efficiency.

You will build and optimize data processing workflows, ensure data quality, and manage migrations while leveraging modern tools such as Dataflow, Beam, and Airflow in a secure, scalable environment.

Qualifications

• 15–20 years of professional data engineering experience.
• Expertise in data warehousing and advanced data modeling.
• Strong Git/GitHub and CI/CD practices.
• Hands-on with Google Dataflow and Apache Beam.
• Experience with cloud migration and data governance.

Responsibilities

• Design data warehousing architectures and data models.
• Build and maintain scalable data pipelines and processing workflows.
• Implement CI/CD pipelines and automated testing for data apps.
• Migrate and manage data across cloud environments with security in mind.
• Operate BigQuery and Dataproc for analytics and processing.
• Orchestrate workflows with Cloud Composer (Airflow).
• Develop event-driven data ingestion using Pub/Sub and Cloud Storage.

Skills

Data Warehousing

Data Modeling

CI/CD

Cloud Data Platforms

Problem Solving

Tools

Git/GitHub

Google Dataflow

Apache Beam

BigQuery

Dataproc

Cloud Composer (Airflow)

Pub/Sub

Cloud Storage

Job description

Data Engineer

Summary

We are seeking an experienced Data Engineer to architect, build, and maintain scalable data infrastructure within the IT Services sector. In this pivotal role, you will drive the design of robust data warehousing solutions and ensure seamless data modeling to support critical business analytics. Your expertise will be essential in managing cloud-native data pipelines, overseeing high-quality data migration strategies, and optimizing large-scale processing workflows. This position offers the opportunity to leverage cutting-edge Google Cloud technologies to transform raw data into actionable insights, directly contributing to the organization's data-driven decision-making capabilities and operational efficiency.

Responsibilities

• Design and implement comprehensive data warehousing architectures and advanced data modeling strategies to meet evolving business needs.
• Develop and maintain efficient version control workflows using Git and GitHub, integrating continuous integration and continuous deployment (CI/CD) pipelines for automated testing and deployment.
• Construct and optimize complex data processing pipelines utilizing Google Dataflow and Apache Beam for real-time and batch data transformation.
• Establish rigorous data quality frameworks and lead strategic cloud migration initiatives to ensure data integrity and security during transitions.
• Manage and scale data storage and processing environments using BigQuery and Dataproc, ensuring high performance and cost-effectiveness.
• Orchestrate scheduled workflows and dependency management through Cloud Composer (Apache Airflow) to guarantee reliable data delivery.
• Implement event-driven data ingestion and storage solutions leveraging Pub/Sub and Cloud Storage to handle high-volume data streams.

Requirements

• Experience: A minimum of 15 to 20 years of professional experience in data engineering and related fields.
• Core Competencies: Proven expertise in Data Warehousing and sophisticated Data Modeling techniques.
• Version Control & DevOps: Strong proficiency with Git/GitHub and the implementation of CI/CD practices.
• Big Data Processing: Hands-on experience with Google Dataflow and Apache Beam for scalable data processing.
• Data Governance: Demonstrated ability in ensuring Data Quality standards and executing successful Cloud Migration projects.
• Cloud Technologies: In-depth knowledge of Google BigQuery and Dataproc for analytics and processing.
• Workflow Orchestration: Skilled in utilizing Cloud Composer (Apache Airflow) for workflow management.
• Messaging & Storage: Familiarity with Pub/Sub and Cloud Storage for data ingestion and archival.