Data Engineer

NetWeb Software

Vadodara

On-site

INR 1,200,000 - 2,400,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

NetWeb Software seeks a data engineer to design and build end-to-end data processing solutions using Microsoft Fabric. You will develop Fabric Data Factory pipelines for batch and incremental ingestion, and construct Lakehouse/ Warehouse architectures with OneLake for centralized data storage.

The role requires strong SQL, Python, PySpark, and data modeling skills, plus experience with data quality and production deployment practices.

Qualifications

  • 3+ years of experience in data engineering with hands-on Fabric
  • Bachelor’s or Master’s degree in CS/IT/Engineering/Data Science
  • Experience building end-to-end data pipelines and production solutions

Responsibilities

  • Design, develop, and maintain end-to-end data engineering solutions using Microsoft Fabric.
  • Build Fabric Data Factory pipelines for batch, scheduled, and incremental ingestion.
  • Develop and maintain Fabric Lakehouse and Warehouse solutions using OneLake.
  • Use Fabric notebooks, Spark, SQL analytics, and Dataflows Gen2 to process data.
  • Apply Medallion Architecture (Bronze, Silver, Gold) for data organization and reuse.
  • Develop robust ETL/ELT processes ingesting data from databases, APIs, files, and SaaS apps.
  • Implement incremental loads, CDC, SCD, partitioning, and related processing.
  • Develop and optimize analytical data models (dimensional, star/snowflake).
  • Use SQL, Python, PySpark, and Spark SQL to transform and prepare data.
  • Implement data quality checks, validation, reconciliation, and recovery mechanisms.
  • Monitor pipelines and data processing; troubleshoot and optimize performance.
  • Document architecture, pipelines, and data models; support CI/CD deployments via Azure DevOps or GitHub.

Skills

Strong SQL skills
Python programming
PySpark
ETL/ELT concepts
Data quality
Git and source control
CI/CD understanding
Analytical thinking

Education

Bachelor’s or Master’s degree in Computer Science/IT/Engineering/Data Science

Tools

Fabric Data Factory/Data Pipelines
Fabric Lakehouse/OneLake
Spark
Fabric notebooks
Dataflows Gen2
SQL analytics

Job description

Microsoft Fabric & Data Platform Development


  • Design, develop, and maintain end-to-end dataengineering solutions using Microsoft Fabric.

  • Build and manage Fabric Data Factory pipelinesfor batch, scheduled, and incremental data ingestion.

  • Develop and maintain Fabric Lakehouse andWarehouse solutions, using OneLake for centralized data storage and management.

  • Use Fabric notebooks, Spark, SQL analytics, andDataflows Gen2 to process and transform data.

  • Apply Medallion Architecture (Bronze, Silver,and Gold) where appropriate for data organization, quality, and reuse.


Data Ingestion, Transformation & Modeling


  • Develop robust ETL/ELT processes to ingest datafrom databases, REST APIs, files, and cloud/SaaS applications.

  • Implement incremental loads, change data capture(CDC), slowly changing dimensions (SCD), partitioning, and other suitableprocessing strategies.

  • Develop and optimize analytical data models,including dimensional models and star/snowflake schemas.

  • Use SQL, Python, PySpark, and Spark SQL totransform, validate, and prepare data for reporting and analytics.

  • Implement data quality checks, validation,reconciliation, error handling, and appropriate recovery mechanisms.


Performance, Reliability & Operations


  • Monitor pipeline execution and data processing;troubleshoot failures and perform root-cause analysis.

  • Optimize Spark jobs, SQL queries, pipelinedesign, and storage usage for performance, scalability, and cost efficiency.

  • Implement logging, monitoring, alerting, andproduction-support practices to improve platform reliability.

  • Support issue resolution and continuousimprovement across data pipelines and platform workloads.


Security, Governance & Deployment


  • Apply appropriate security controls, workspaceaccess, identity and access management, and data access practices with platformand security teams.

  • Follow data governance, documentation, andengineering standards; support data lineage and governance requirements whereapplicable.

  • Use Git-based source control and support CI/CDand deployment processes for Fabric solutions through Azure DevOps or GitHub.

  • Document data architecture, pipelines, datamodels, dependencies, operational procedures, and technical decisions.


Collaboration & Business Alignment


  • Work with Power BI teams to provide curated,trusted, analytics-ready datasets and support semantic-model requirements.

  • Collaborate with analysts, data scientists,application teams, and business stakeholders to understand requirements anddeliver practical solutions.

  • Contribute to design reviews, estimation, sprintplanning, testing, release activities, and continuous improvement in an Agiledelivery environment.


Required Qualifications

Experience & Education


  • 3+ years of experience in data engineering, withmandatory hands-on experience developing solutions in Microsoft Fabric.

  • Bachelor’s or Master’s degree in ComputerScience, Information Technology, Engineering, Data Science, or a related field;equivalent professional experience may be considered.

  • Experience building end-to-end data pipelinesand supporting data solutions through development, deployment, and production.


Microsoft Fabric Skills


  • Hands-on experience with Fabric Data Factory /Data Pipelines, Lakehouse, Warehouse, OneLake, notebooks, Spark, SQL analytics,and Dataflows Gen2.

  • Understanding of Microsoft Fabric architecture,workspaces, and end-to-end data processing patterns.

  • Ability to develop, troubleshoot, and optimizeproduction-ready data pipelines in Microsoft Fabric.

  • Familiarity with Fabric data agents and theirpotential use in data discovery or conversational access to data.


Core Data Engineering Skills


  • Strong SQL skills, including complex queries,joins, CTEs, window functions, and query optimization.

  • Strong programming knowledge in Python and/orPySpark, with practical experience in data transformation and processing.

  • Solid understanding of ETL/ELT concepts, batchand incremental processing, data warehousing, and dimensional modeling.

  • Experience with data quality, validation,reconciliation, and reliable pipeline design.

  • Working understanding of cloud security,identity, access management, and secure handling of enterprise data.

  • Experience with Git and source control, andfamiliarity with Azure DevOps or GitHub.

  • Understanding of CI/CD pipelines, automateddeployment, environment management, and release practices.

  • Experience with monitoring, logging,troubleshooting, and production support.


Preferred Qualifications


  • Microsoft Certified: Fabric Data EngineerAssociate (DP-700) is preferred; Microsoft Certified: Fabric Analytics EngineerAssociate (DP-600) is also relevant.

  • Experience migrating data solutions from AzureSynapse Analytics, Azure Data Factory, Databricks, or traditional datawarehouses to Microsoft Fabric.

  • Experience with Power BI semantic models andDAX.

  • Knowledge of Microsoft Purview, data governance,data lineage, and compliance practices.

  • Exposure to real-time analytics, Eventstream, orReal-Time Intelligence in Microsoft Fabric.

  • Experience integrating REST APIs and SaaS datasources.

  • Familiarity with Microsoft Azure AI Foundry /Microsoft Foundry and its data or AI-related capabilities.

  • Experience working in Agile/Scrum teams.


Preferred Candidate Profile


  • Strong analytical thinking, problem-solving, andattention to data quality.

  • Able to work independently while collaboratingeffectively with cross-functional teams.

  • Clear communication and technical documentationskills.

  • Able to translate business requirements intoscalable and maintainable data solutions.

  • Takes ownership of data engineering solutionsfrom design and development through deployment and production support.

  • Shows initiative in learning and applyingevolving Microsoft Fabric and modern data engineering capabilities.


Key Success Measures


  • Reliable, maintainable, and well-documentedFabric pipelines delivered to agreed timelines.

  • Improved data quality, reconciliation, andavailability of trusted analytics-ready datasets.

  • Effective pipeline and query performance, withappropriate cost and resource optimization.

  • Timely resolution of pipeline issues andadherence to security and engineering standards.

  • Effective collaboration with reporting,analytics, application, and business teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Azure Data Engineer
Azure Data Engineer

Ignitho • Chennai District

Hybrid
INR 900,000 - 1,300,000
Data Engineer - MS Fabric & Azure
Data Engineer - MS Fabric & Azure

WPP Company • Gurugram District

On-site
INR 2,500,000 - 4,200,000
Lead Data Architect - Microsoft Fabric
Lead Data Architect - Microsoft Fabric

Weekday • India

Remote
INR 4,000,000 - 7,000,000
Lead Data Architect (Fabric)
Lead Data Architect (Fabric)

Weekday AI • India

Remote
INR 2,000,000 - 6,000,000
Lead Data Architect - Microsoft Fabric
Lead Data Architect - Microsoft Fabric

TigerHire • India

Remote
INR 2,000,000 - 6,000,000
Microsoft Fabric Data & Analytics Solutions Engineer
Microsoft Fabric Data & Analytics Solutions Engineer

HMH • Maharashtra

On-site
INR 1,200,000 - 2,400,000
Senior Data Engineer - Microsoft Fabric & Power BI
Senior Data Engineer - Microsoft Fabric & Power BI

Promaynov Advisory Services Pvt. Ltd • Hyderabad

On-site
INR 1,500,000 - 2,400,000
Data Engineer
Data Engineer

Rail Infotech • Hyderabad

On-site
INR 1,400,000 - 2,200,000
Senior Data Engineer
Senior Data Engineer

SOTIIND SOTI India Private Ltd. • Ernakulam

On-site
INR 1,500,000 - 2,000,000
Microsoft Fabric Data & Analytics Solutions Engineer
Microsoft Fabric Data & Analytics Solutions Engineer

Hackensack Meridian Health • Mumbai City

On-site
INR 900,000 - 1,500,000