Sr Data Engineer - Azure Fabric

Simform; Ahmedabad District; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Free health insurance

Certification sponsorship

Flexible work hours

Hybrid work options

Office facilities and snacks

Job summary

Simform is seeking a Senior Data Engineer (Azure) to design and manage large-scale data pipelines in Ahmedabad. You will work with Microsoft Fabric services, ETL/ELT processes, and multiple data stores to deliver robust data architectures.

The role requires 4+ years in data engineering, strong Python/SQL, and experience with Fabric, Spark, Kafka, and Airflow. Collaboration with data scientists and engineers is essential, with hybrid work options.

Qualifications

• 4+ years hands-on data engineering experience.
• Proficiency in Python and SQL for data processing.
• Strong expertise in Microsoft Fabric (Pipelines, Dataflows Gen2, Lakehouse, Notebooks).
• Experience with big data frameworks like Spark, Kafka and Airflow.
• Working knowledge of cloud data warehouses (Synapse, Snowflake, Redshift, BigQuery).
• Experience with NoSQL and relational databases.
• Strong analytical and problem-solving skills.
• Ability to work independently and mentor peers.

Responsibilities

• Design, develop, monitor, and maintain end-to-end data pipelines on Microsoft Fabric.
• Develop and optimize ingestion, transformation, and analytical workflows for structured and unstructured data.
• Design efficient data models for performance.
• Implement large-scale data ingestion pipelines handling TBs of data.
• Build data solutions using Fabric, Kafka, Spark, Airflow, Databricks.

Skills

Strong analytical skills

Excellent communication skills

Education

Bachelor’s/Master’s in Computer Science or related

Tools

Python

SQL

Microsoft Fabric

Spark

Kafka

Airflow

Databricks

Synapse

NoSQL databases

Relational databases

Job description

Job Description:

Job Title:Senior Data Engineer (Azure)

Location:Ahmedabad, Gujarat

Experience:4+ years

Job Type: Full Time

Department:Data Engineering

About Simform:

Simform is a premier digital engineering company specializing in Cloud, Data, AI/ML, and Experience Engineering to create seamless digital experiences and scalable products. Simform is a strong partner for Microsoft, Google Cloud, and Databricks. With a presence in 5+ countries, Simform primarily serves North America, the UK, and the Northern European market.Simform takes pride in being one of the most reputed employers in the region, having created a thriving work culture with a high work-life balance that gives a sense of freedom and opportunity to grow.

Role Overview:

We are looking for a Senior Data Engineer (Azure)who is passionate about managing large-scale data, eager to take on challenges, and committed to delivering exceptional results. This role requires expertise in Azure data services, ETL pipelines, and database management. If you are a proactive problem solver with a strong technical background and a team player with a positive attitude, we want to hear from you.

Key Responsibilities

• Design, develop, monitor, and maintain end-to-end data pipelines on Microsoft Fabric.

• Work with Microsoft Fabric servicessuch as

  • Fabric Pipelines (ETL/ELT)

  • Fabric Dataflows Gen2

  • Fabric Lakehouse (Bronze/Silver/Gold architecture)

  • Fabric Warehouse (SQL analytics engine)

  • OneLake (unified storage)

  • Fabric Notebooks (PySpark / Spark SQL)

  • Direct Lake mode for Power BI

  • Fabric KQL Database / Eventstream / Real-Time Hub

  • Fabric Shortcuts (cross‑workspace & multi-cloud virtualization)

  • Semantic Models

  • Data Activator (alerting / action triggers) For ingestion, transformation, modeling, analytics, and real-time processing.

• Develop and optimize data ingestion, transformation, and analytical workflows for structured and unstructured data.

• Design efficient data models to ensure optimal performance in data processing and storage.

• Implement large-scale data ingestion pipelines capable of handling TBs of data.

• Build distributed batch or real-time data solutions using Apache Kafka, Apache Airflow, Databricks, or Fabric Real-Time Hub components.

• Build and maintain ETL/ELT pipelines for data integration and migration.

• Work extensively with relational databases (PostgreSQL, MySQL, SQL Server) and NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB).

• Optimize SQL queries, performance tuning, indexing, partitioning, and denormalization strategies.

• Collaborate with cross-functional teams, including data scientists and software engineers, to integrate data solutions into production environments.

• Ensure data quality, integrity, governance, lineage, and compliance with security best practices.

• Participate in client interactions and stakeholder meetings to gather requirements and provide technical insights.

Required Skills & Qualifications

• Bachelor’s/Master’s degree in Computer Science, Data Engineering, or a related field.

• 4+ years of hands-on experience in data engineering, ETL development, and data pipeline implementation.

• Proficiency in Python and SQL for data processing and analysis.

• Strong expertise in Microsoft Fabric (Pipelines, Dataflows Gen2, Lakehouse, Warehouse, OneLake, Notebooks, Direct Lake, KQL Database, Real-Time Hub, Eventstream, Shortcuts, Semantic Models).

• Experience with big data frameworks like Spark, Kafka, and Airflow.

• Working knowledge of cloud data warehouse solutions such as Synapse, Snowflake, Redshift, or BigQuery.

• Experience with NoSQL databases (MongoDB, CosmosDB, Cassandra, GraphDB) and relational databases.

• Strong analytical and problem-solving skills.

• Ability to work independently, mentor peers, and meet tight deadlines.

• Excellent interpersonal and communication skills.

• Experience with cloud-based data architecture and security best practices.

• Fabric certifications are a plus (DP‑600, DP‑700, Fabric Analytics/Data Engineer Associate).

Preferred Qualifications (Nice to Have)

• Experience with data lake architectures.

• Knowledge of machine learning model deploymentand data processing for AI applications.

• Prior experience in automated data pipeline deployment using CI/CD workflows.

Why Join Us:

• Young Team, Thriving Culture

• Flat-hierarchical, friendly, engineering-oriented, and growth-focused culture.

• Well-balanced learning and growth opportunities

• Free health insurance.

• Office facilities with a game zone, an in-office kitchen with affordable lunch service, and free snacks.

• Sponsorship for certifications/events and library service.

• Flexible work timing, leaves for life events, WFH, and hybrid options.