Azure Data Engineer - Cosmos DB.

Cerebra; Hyderabad, Pune District, Bengaluru; Hybrid; INR 1,600,000 - 2,300,000; Full time

Job summary

Cerebra is seeking an Azure Data Engineer to join our team in India with roles based in Pune, Hyderabad, or Bangalore. You will design and implement Cosmos DB driven data models, build scalable data pipelines with PySpark and Azure Data Factory, and optimize performance.

The role requires strong CI/CD practices and familiarity with Microsoft Fabric for analytics workflows. Ideal candidates have 8–10 years of experience in data engineering, and are proficient in Python, Cosmos DB APIs, and data

Qualifications

• 8–10 years of experience in data engineering or related field.
• Strong hands-on experience with Cosmos DB and its APIs.
• Proficient in PySpark, Python, and Azure Data Factory.
• Experience designing scalable data models, indexing, and partitioning.
• Familiarity with CI/CD and modern data engineering workflows.

Responsibilities

• Design and implement scalable Cosmos DB solutions.
• Model data, index, partition, and tune Cosmos DB performance.
• Develop data pipelines using PySpark and Azure Data Factory.
• Collaborate on cloud architecture and data modeling best practices.
• Implement and maintain CI/CD pipelines for deployments and tests.
• Troubleshoot Cosmos DB and data pipelines issues.
• Work with Microsoft Fabric for analytics workflows.
• Follow QA practices with TDD/BDD and source-control with Git/GitHub.

Skills

Azure Cosmos DB

Cosmos DB API

PySpark

Python

Azure Data Factory

Microsoft Fabric

PyTest

Git

GitHub

TDD

BDD

Azure Purview

Azure SQL Managed Instance

Azure Storage Services

Azure Functions

Data Modeling

Indexing

Partitioning

Query Optimization

Performance Tuning

CI/CD

Tools

Git

GitHub

PyTest

Azure Data Factory

Cosmos DB APIs

CI/CD pipelines

Job description

Role: Azure Data Engineer

Experience: 8 to 10 Years

Location: Pune, Hyderabad, Bangalore

Job Description

• Design and implement scalable, high-performance solutions using Azure Cosmos DB.
• Strong hands‑on experience with Cosmos DB data modeling, indexing, partitioning, consistency levels, and performance tuning.
• Strong understanding of Cosmos DB APIs, including Core SQL API and MongoDB API.
• Develop data ingestion and transformation pipelines using PySpark, Python, and Azure Data Factory.
• Optimize Cosmos DB performance through indexing, partitioning, and query tuning.
• Collaborate with architects and data engineers on data modeling and cloud architecture best practices.
• Implement and maintain CI/CD pipelines for automated deployments and testing.
• Troubleshoot and resolve technical issues related to Cosmos DB and data pipelines.
• Experience with Microsoft Fabric for data engineering and analytics workflows.
• Experience with Git/GitHub and TDD/BDD.
• Exposure to Azure Purview, Azure SQL Managed Instance, Azure Storage Services, and Azure Functions is an advantage.
• Java is not required for this position.

Skills

Azure Cosmos DB, Cosmos DB API, PySpark, Python, Azure Data Factory, Microsoft Fabric, PyTest, Git, GitHub, TDD, BDD, Azure Purview, Azure SQL Managed Instance, Azure Storage Services, Azure Functions, Data Modeling, Indexing, Partitioning, Query Optimization, Performance Tuning, CI/CD