Senior Data Engineer

Softobiz; Kerala; Hybrid; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Leading-Edge Innovation

Global Exposure

Upskilling & Certification Support

Job summary

Softobiz in Kochi is seeking a Senior Data Engineer with 8–15 years of experience to join our Architecture & Delivery Team on a fully onsite basis. You will design, build, and optimize robust data pipelines using Azure Data Factory and Dataflows, driving modernization into repeatable software products.

You will work within the AiDLC framework, delivering secure, scalable data solutions for global clients, and contribute to analytics delivery using Microsoft Fabric and Power BI during rapid

Qualifications

• 8–15 years of experience in data engineering or related field.
• Strong experience designing and building scalable data pipelines in Azure.
• Experience with ADF, Dataflows, Microsoft Fabric, and Power BI.
• Knowledge of data governance and security baselines.

Responsibilities

• Design, build, and optimize scalable data pipelines using ADF and Dataflows.
• Deliver automated data solutions for migrations and modernization.
• Embed intelligent agents for data stewardship within pipelines.
• Provide analytics delivery using Fabric and Power BI for end users.

Skills

Azure Data Factory

Data pipelines

Microsoft Fabric

Power BI

Data governance

Agile delivery

Security compliance

Tools

Purview

Dataverse

Azure

Job description

We are looking for a skilled and driven Senior Data Engineer with 8 to 15 years of experience to join our Architecture & Delivery Team in Kochi on a fully onsite basis. In this role, you will focus heavily on designing, building, and optimizing robust data pipelines using Microsoft Azure Data Factory (ADF) and Dataflows. Operating under our specialized Agentic Development Lifecycle (AiDLC), you will transition standard data migration and modernization tasks into repeatable, high-margin software products. You will build automated data tools and embed smart, subscription-enabling validation agents into software deployed for our global clients, maintaining strict engineering and security baselines throughout a rapid 90-day deployment lifecycle.

Key Responsibilities

Pipeline & Product Engineering

• Design & Build Pipelines: Develop, orchestrate, and maintain scalable data ingestion and transformation pipelines using Azure Data Factory (ADF) and Dataflows.
• Accelerate Migrations: Build automated data solutions and core data assets focusing on the Data Migration Accelerator for Dynamics 365, Dataverse, and Microsoft Fabric.
• Embed Agentic Logic: Develop and integrate intelligent, automated agents (including validation, reconciliation, and data-stewardship agents) within pipelines to shift client value from one-time migration builds to ongoing, subscription-based service models.
• Analytics Delivery: Create and pre-package robust Analytics & Insights Accelerators utilizing Microsoft Fabric and Power BI to maximize day-one reporting capabilities for end-users.

Governance, Delivery Standards & Quality

• Data Governance: Implement and enforce native data governance, security baselines, and tracking frameworks seamlessly across environments using Microsoft Purview.
• Agile Delivery: Deliver and deploy all assigned data products utilizing the internal Agentic Development Lifecycle (AiDLC), adhering strictly to a 90-day development-to-production cycle (the "3-month rule").
• Quality Assurance: Ensure all data pipelines and products strictly align with ISO/IEC 25010 software quality standards and pass uncompromising security clearance checks before entering active client environments.

What We Offer

• Leading-Edge Innovation: Deep, direct engagement with emerging technologies like Agentic AI orchestration, Micro-Agent Architectures, and advanced Microsoft Fabric implementations.
• Global Exposure: Opportunity to contribute directly to data systems deployed for premier enterprise clients across Australia, the US, and India.
• Upskilling & Certification Support: Structured organizational tracking and learning assistance to clear premier Microsoft and Azure technical certifications.