Data Engineer

Valuelabs; Hyderabad; Vor Ort; INR 1.400.000 - 2.100.000; Vollzeit

Zusammenfassung

Valuelabs is seeking a skilled Cloud Data Engineer with 8+ years of experience to design, build, and maintain scalable data pipelines in a cloud-native environment. You will work across multi-cloud platforms to support analytics, ML, and BI initiatives and collaborate with data scientists and stakeholders to deliver governed data assets.

The role emphasizes automation, observability, and modern data platforms such as Databricks, Snowflake, and BigQuery, with a focus on reliability and

Qualifikationen

• 8+ years of experience in cloud data engineering and building scalable data pipelines.
• Hands-on with major cloud platforms and data processing architectures.
• Experience with orchestration, storage, and multi-cloud data solutions.

Aufgaben

• Design, build, and maintain cloud-native data pipelines across AWS, Azure, or GCP.
• Implement data ingestion, transformation, and loading using Airflow or Cloud Composer.
• Develop data lake/lakehouse architectures with S3, ADLS, and GCS.
• Optimize pipelines for performance, reliability, and observability in production.
• Collaborate with data scientists and analysts to deliver governed data assets.
• Troubleshoot incidents with root-cause analysis and remediation plans.
• Contribute to CI/CD and infrastructure-as-code using Terraform, Docker, and Kubernetes.
• Ensure data quality, governance, and security across assets.
• Support adoption of Databricks, Snowflake, or BigQuery.

Kenntnisse

Data pipelines

Cloud platforms

Airflow

Terraform

Docker

Kubernetes

Tools

Airflow

Cloud Composer

Terraform

Docker

Kubernetes

S3

ADLS

GCS

Databricks

Snowflake

BigQuery

Jobbeschreibung

We are seeking a skilled Cloud Data Engineer with 8+ years of experience to design, build, and maintain scalable, high-performance data pipelines in a cloud-native environment. The ideal candidate will have hands-on experience with major cloud platforms and a strong foundation in data engineering principles, including orchestration, storage, and large-scale data processing. You will play a key role in developing and optimizing data solutions that support analytics, machine learning, and business intelligence initiatives across multi-cloud environments.

Roles and Responsibilities

• Cloud Data Engineer,Data Pipeline Architect,Design, develop, and maintain cloud-native data pipelines using AWS, Azure, or GCP.
• Implement and manage data ingestion, transformation, and loading processes using tools like Airflow, Cloud Composer, or similar orchestration platforms.
• Work with cloud storage services such as AWS S3, Azure Data Lake Storage (ADLS), and Google Cloud Storage (GCS) to build scalable data lake and lakehouse architectures.
• Optimize data pipeline performance and ensure reliability, scalability, and observability in production environments.
• Collaborate with data scientists, analysts, and stakeholders to deliver high-quality, governed data assets.
• Troubleshoot and resolve production incidents with a focus on root cause analysis and long-term prevention.
• Contribute to CI/CD practices and infrastructure-as-code using Terraform, Docker, and Kubernetes.
• Ensure data quality, consistency, and governance across all data assets.
• Support the adoption of modern data platforms such as Databricks, Snowflake, or BigQuery.