Cloud Data Engineer

Statusneo Technology Consulting; Bengaluru; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Statusneo Technology Consulting is seeking a Cloud Data Engineer to design, build, and maintain scalable data solutions on cloud platforms. You will work with data analysts, data scientists, and business stakeholders to deliver reliable data pipelines that support BI and analytics initiatives.

The role requires strong SQL, Python/PySpark/Scala expertise, experience with Spark/Hadoop, and proficiency in CI/CD, Docker, and Kubernetes.

Qualifications

• Strong experience with cloud platforms (Azure preferred).
• Proficiency in SQL and database technologies.
• Experience with Python, PySpark or Scala.
• Hands-on with Apache Spark, Hadoop or similar big data tech.
• CI/CD pipelines and DevOps tooling experience.
• Familiarity with Docker and Kubernetes.

Responsibilities

• Design, build and maintain scalable data pipelines and ETL/ELT processes.
• Develop cloud-based data platforms on AWS, Azure or GCP.
• Create data ingestion frameworks for structured and unstructured data.
• Implement data lakes, data warehouses and data marts.
• Ensure data quality, governance, and security standards.

Skills

SQL proficiency

Python/PySpark/Scala

DevOps/CI/CD

Containerization (Docker/Kubernetes)

Big data technologies (Spark/Hadoop)

Tools

Azure

AWS

GCP

ADF/Synapse/Databricks

Job description

a { text-decoration: none; color: #464feb; } tr th, tr td { border: 1px solid #e6e6e6; } tr th { background-color: #f5f5f6; }

Job Summary

We are seeking a highly skilled Cloud Data Engineer to design, build, and maintain scalable data solutions on cloud platforms. The ideal candidate will have expertise in data engineering, ETL/ELT development, cloud services, data warehousing, and big data technologies. The Cloud Data Engineer will work closely with data analysts, data scientists, and business stakeholders to deliver reliable and secure data pipelines that support business intelligence and analytics initiatives.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build and manage cloud-based data platforms using AWS, Azure, or Google Cloud Platform (GCP).
• Develop data ingestion frameworks for structured and unstructured data.
• Implement and optimize data lakes, data warehouses, and data marts.
• Ensure data quality, security, governance, and compliance standards are met.
• Monitor and troubleshoot data workflows and performance issues.
• Collaborate with business teams, data scientists, and analysts to understand data requirements.
• Automate deployment processes using DevOps and Infrastructure-as-Code (IaC) practices.
• Optimize cloud resource utilization and control operational costs.
• Document data architecture, processes, and technical specifications.

Required Skills & Qualifications

Technical Skills

• Strong experience with cloud platforms:
• Microsoft Azure (preferred)
• AWS
• GCP
• Expertise in SQL and database technologies.
• Experience with Azure Data Factory (ADF), Azure Synapse Analytics, Databricks, or equivalent tools.
• Proficiency in Python, PySpark, or Scala.
• Hands-on experience with Apache Spark, Hadoop, or other big data technologies.
• Knowledge of data warehousing concepts and dimensional modeling.
• Experience with CI/CD pipelines and DevOps tools.
• Familiarity with containerization technologies such as Docker and Kubernetes.