Senior Data Engineer

Cloudaeon; Pune District; Hybrid; INR 2,800,000 - 4,200,000; Full time

Job summary

Cloudaeon in Pune (Hybrid) is seeking a Senior Azure Data Engineer to design and deliver modern data solutions on Azure. You will lead data engineering initiatives, mentor junior engineers, and evolve data products with scalable, secure architectures and CI/CD integration.

A solid foundation in AI/ML concepts is helpful as the role may transition toward AI Engineering. You will work with ADF, Databricks, Synapse, and Delta Lake to build pipelines across bronze to gold, supporting real-time data

Qualifications

• 5+ years of experience in Azure data engineering (ADF, Databricks, Python, PySpark, SQL).
• Strong data warehousing and data modelling skills.
• Experience building production-grade ETL/ELT pipelines and CI/CD.

Responsibilities

• Design, build, and optimize modern data pipelines and real-time/near real-time data streams.
• Transform and move data across bronze, silver, and gold layers using ADF, Python, and PySpark.
• Evaluate current data practices and identify opportunities for modernization.
• Leverage Azure Data Platform capabilities including ADF, ADLS, Databricks, Synapse, Azure Functions, Event Hub, and Azure Data Explorer.
• Support planning, architecture, and deployment of scalable data platform services (sizing, configuration, cost optimization).
• Implement automated monitoring, alerts, and operational dashboards.
• Ensure CI/CD and DevOps integration of data pipelines.
• Collaborate with stakeholders and act as technology advisor.
• Provide technical leadership, code reviews, and mentorship to junior data engineers.
• Prepare AI-ready datasets, support feature engineering, vectorization, embeddings, and ML workflows using Azure ML and Databricks AI.
• Contribute to RAG pipelines, semantic search, and model deployment integrations.

Skills

Leadership

Mentorship

Communication

Problem-solving

Azure knowledge

Tools

Azure Data Factory

Databricks

Python

PySpark

SQL

ADLS

Delta Lake

Synapse

Azure DevOps CI/CD

Job description

Sr Azure Data Engineer

Job Description

About Cloudaeon:

Cloudaeon is a global technology consulting and services company helping enterprises modernize and manage their cloud infrastructure, big data ecosystems, DevOps pipelines, and advanced analytics platforms. We deliver high-quality, scalable solutions built on deep domain expertise and leading enterprise data technologies. Our teams work actively on AI and GenAI initiatives, incorporating machine learning, intelligent automation, and modern data engineering practices to create future-ready digital solutions. With a highly skilled global team committed to excellence, we consistently exceed customer expectations and help organizations achieve their strategic goals.

Job Role Sr Azure Data Engineer

Experience - 5+ years

Location: Pune (Hybrid)

Job description:

We are looking for a Senior Azure Data Engineer with strong expertise in designing and delivering modern data solutions on the Azure platform. The ideal candidate will lead data engineering initiatives, mentor junior engineers, and contribute to building scalable, secure, and high-quality data products. A strong foundational understanding of AI/ML concepts is essential, enabling a smooth transition into AI Engineering over time.

Responsibilities:

• Design, build, and optimize modern data pipelines and real-time/near real-time data streams.
• Transform and move data across bronze, silver, and gold layers using ADF, Python, and PySpark.
• Evaluate current data practices and identify opportunities for improvement and modernization.
• Leverage Azure Data Platform capabilities including ADF, ADLS, Databricks, Synapse, Azure Functions, Event Hub, and Azure Data Explorer.
• Support planning, architecture, and deployment of scalable data platform services (sizing, configuration, and cost optimization).
• Implement automated monitoring, alerts, and operational dashboards.
• Ensure CI/CD and DevOps integration of data pipelines.
• Collaborate closely with stakeholders and work as a trusted technology advisor.
• Provide technical leadership, code reviews, and mentorship to junior data engineers.
• Prepare AI-ready datasets, support feature engineering, vectorization, embeddings, and ML workflows using Azure Machine Learning and Databricks AI.
• Contribute to RAG pipelines, semantic search, and model deployment integrations.

Requirements:

• 5+ years of experience with Azure Data Engineering (ADF, Databricks, Python, PySpark, SQL).
• Strong understanding of data warehousing and data modelling.
• Proven experience building production-grade ETL/ELT pipelines.
• Hands-on experience with ADLS, Delta Lake, Synapse, Azure DevOps CI/CD.
• Ability to convert business requirements into scalable technical solutions.
• Excellent communication and problem-solving skills.
• Customer-centric mindset with passion for engineering quality.
• Working knowledge of Databricks AI, MLflow, model serving, feature store, vector search, and AI/ML workflows.