Digital Senior Engineer

Sonata Software; Bengaluru; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Sonata Software in Bengaluru is seeking a Senior Data Engineer with hands-on experience in Azure Data Factory, Microsoft Fabric, SQL, PySpark and Python. You will design and maintain ETL/ELT pipelines, build data warehouse solutions, and apply data-modeling best practices.

You will also explore AI-assisted development tools like Claude and GitHub Copilot to boost development speed and quality. Collaboration with architects, BI teams, analysts, and other stakeholders, plus implementing CI/CD with

Qualifications

• Hands-on experience with Azure Data Factory and Microsoft Fabric.
• Proficiency in SQL, PySpark, and Python for data processing.
• Exposure to AI-assisted development tools and GenAI workflows.
• Familiarity with CI/CD and DevOps practices in cloud data projects.

Responsibilities

• Design, develop and maintain ETL/ELT pipelines using ADF and Fabric Data Factory.
• Build Fabric Notebooks, Lakehouse, Data Warehouse and medallion architectures with PySpark and SQL.
• Analyze, transform and integrate data from multiple sources; ensure data quality and governance.
• Collaborate with architects, BI developers, QA, analysts and stakeholders to translate requirements.
• Implement CI/CD, automation, monitoring, and adhere to data security standards.

Skills

Azure Data Factory

Microsoft Fabric

SQL

PySpark

Python

Claude / ClaudeCode

GitHub Copilot

AI-assisted development

Data Engineering

CI/CD

Tools

Azure DevOps

Git

Job description

Primary Skills

Azure Data Factory (ADF) | Microsoft Fabric | Claude / ClaudeCode | AI-Assisted Development | SQL | PySpark | Python

Position Overview

We are looking for a Senior Data Engineer with strong hands-on experience in Azure Data Factory, Microsoft Fabric, SQL, and modern data-engineering practices. The candidate should also have practical exposure to AI-driven development tools such as Claude, Claude Code, GitHub Copilot, or Fabric AI capabilities to accelerate development and improve engineering productivity.

Roles & Responsibilities

1. Data Engineering & Development

• Design, develop, and maintain ETL/ELT pipelines using Azure Data Factory (ADF).
• Develop data integration workflows using ADF and Microsoft Fabric Data Factory.
• Build and maintain Fabric Notebooks, Lakehouse, Data Warehouse, and Medallion Architecture solutions using PySpark and SQL.
• Analyze, transform, and integrate data from multiple sources.
• Develop and optimize complex SQL queries, stored procedures, and data models.
• Ensure data quality through validation, reconciliation, exception handling, governance, and security practices.

2. AI-Driven Engineering

• Leverage AI tools such as Claude, Claude Code, GitHub Copilot, and Fabric AI capabilities to improve productivity and accelerate software delivery.
• Apply AI-assisted coding, debugging, documentation, unit testing, and code optimization in day-to-day development.
• Utilize Generative AI to enhance data engineering workflows and automate repetitive development activities.
• Identify opportunities to integrate AI-assisted approaches into modern data-engineering practices.

3. Collaboration & Delivery

• Collaborate with Solution Architects, Technical Leads, BI Developers, QA teams, Data Analysts, and business stakeholders.
• Participate in technical design, code reviews, troubleshooting, and production support.
• Translate business requirements into scalable cloud data solutions.
• Contribute to coding standards, reusable frameworks, and engineering best practices.

4. DevOps & Automation

• Implement CI/CD practices using Azure DevOps and/or GitHub.
• Automate deployment, testing, monitoring, and operational processes.
• Follow Git best practices, DataOps principles, and documentation standards.

Required Skills

• Strong hands-on experience in Azure Data Factory (ADF).
• Strong knowledge of Azure SQL Database/SQL Server, T-SQL, and Stored Procedures.
• Experience with Azure Data Lake Storage (ADLS Gen2).
• Good understanding of Microsoft Fabric and modern data-engineering practices.
• Experience with Data Warehouse concepts, Fact/Dimension modeling, and Star Schema.
• Intermediate knowledge of Python and working knowledge of PySpark.
• Experience with Azure DevOps/Git and CI/CD.
• Practical exposure to AI-assisted development tools such as Claude, Claude Code, or GitHub Copilot.
• Strong analytical, problem-solving, and communication skills.

Good to Have

• Microsoft Fabric - Data Factory, Lakehouse, and Warehouse.
• Azure Logic Apps.
• Power BI Semantic Models.
• Experience with Generative AI-based automation and AI-driven engineering workflows.

Important Screening Criteria

Candidates must have practical exposure to AI-assisted development, preferably Claude or ClaudeCode, along with core Azure Data Engineering skills. Profiles with only traditional data engineering experience and no AI-driven development exposure should not be shortlisted.