Senior Data Engineer

Moolya Software Testing; Bengaluru; Hybrid; INR 3,500,000 - 6,500,000; Full time

Job summary

Moolya Software Testing seeks a data engineer to design and maintain scalable data pipelines using ADF, Synapse, and Fabric in Bengaluru. You will build data solutions with Data Lake, Cosmos DB, and Azure SQL, ensuring data quality and governance across structured and unstructured datasets.

Experience with AI-enabled features like RAG, vector search, and Azure AI Search is a plus; collaboration with cross-functional teams is essential for delivering enterprise-scale analytics.

Qualifications

• Bachelors degree in CS/IT/Engineering or related field.
• Hands-on with ADF, Synapse, Fabric, Data Lake, Cosmos DB, and Azure SQL.
• Strong SQL, Python, and data engineering concepts.
• Experience building ETL/ELT pipelines and enterprise-scale data solutions.
• Understanding cloud data architectures, governance, and performance optimization.
• Strong analytical and communication skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines using ADF, Synapse, and Fabric.
• Build and optimize data solutions leveraging Data Lake, Cosmos DB, Azure SQL, and Synapse.
• Implement ingestion, transformation, and integration for structured and unstructured data.
• Develop and support data platforms, warehousing, and analytics.
• Enable AI use cases with RAG, vector search, and Azure AI Search integrations.
• Collaborate with business, consulting, and engineering teams to ensure data quality, security, and governance.

Skills

ADF

Synapse

Fabric

Data Lake

Cosmos DB

Azure SQL

SQL

Python

ETL/ELT

Data Modeling

Governance

Cloud Architecture

AI Search

RAG

Spark

PySpark

Fabric Lakehouse

DevOps

CI/CD

Infrastructure as Code

Education

Bachelor's degree in Computer Science/Information Technology/Engineering

Tools

Spark

PySpark

Fabric Lakehouse

DevOps

CI/CD

Infrastructure as Code

Job description

Mandatory skills - ADF, Synapse, Microsoft Fabric

Day to Day Job Duties:

• Design, develop, and maintain scalable data pipelines using Azure Data Factory(ADF), Azure Synapse Analytics, and Microsoft Fabric.
• Build and optimize enterprise data solutions leveraging Azure Data Lake, Cosmos DB, Azure SQL, and Synapse.
• Implement data ingestion, transformation, and integration processes for structured and unstructured data.
• Develop and support modern data platforms, data warehousing, and analytics solutions.
• Enable AI and GenAI use cases by supporting RAG (Retrieval-Augmented Generation), vector search, and Azure AI Search integrations.
• Collaborate with business, consulting, and engineering teams to deliver data-driven solutions and ensure data quality, security, and governance.

Basic Qualifications:

• Bachelors degree in computer science, Information Technology, Engineering, or related field.
• Hands-on experience with Azure Data Factory (ADF), Azure Synapse Analytics, Microsoft Fabric, Azure Data Lake, Cosmos DB, and Azure SQL/Synapse.
• Strong proficiency in SQL, Python, and data engineering concepts.
• Experience building ETL/ELT pipelines, data models, and enterprise-scale data solutions.
• Understanding of cloud-based data architectures, data governance, and performance optimization.
• Strong analytical, problem-solving, and communication skills.

Preferred Qualifications:

• Experience with Azure AI Search, vector databases, embeddings, and RAG-based

AI solutions.

• Knowledge of Spark, PySpark, and Fabric Lakehouse architectures.
• Experience with DevOps, CI/CD pipelines, and Infrastructure as Code.
• Microsoft Azure or Fabric certifications preferred.
• Experience working within Agile delivery and consulting environments