Sr. Data Engineer

Artic Consulting; Ahmedabad District; On-site; INR 1,200,000 - 1,800,000; Full time

Benefits offered by this job

Flexible working hours

Remote work options

Job summary

Artic Consulting is seeking a skilled Data Engineer with a strong focus on the Microsoft Fabric ecosystem and Azure data services to design scalable data solutions for clients. The role involves building OLTP databases, developing Power BI reports, and orchestrating ETL/ELT pipelines.

You will collaborate with cross-functional teams to deliver secure, performant data platforms, using SQL, Spark, and Fabric tools to support AI/ML workloads.

Qualifications

• Hands-on experience in Power BI development and enterprise dashboards.
• Strong T-SQL and KQL query optimization skills.
• Experience managing Azure SQL databases with performance tuning.
• Proficiency with Fabric tools: Data Pipelines, Dataflows Gen2, OneLake.
• Knowledge of data modeling (star/snowflake) and modern data warehousing.

Responsibilities

• Design and implement scalable data solutions using Fabric and Azure data services.
• Develop ETL/ELT pipelines and integrate diverse data sources.
• Craft and optimize SQL and KQL queries for Synapse SQL/SQL Server.
• Collaborate with client teams to ensure secure, scalable data platforms.
• Ensure data governance, privacy, and compliance.

Skills

Power BI development

T-SQL

KQL

Azure SQL

Fabric Data Pipelines

Notebooks (Fabric)

PySpark

Data Integration

SQL performance tuning

Data governance

Education

Bachelor's or Master's degree in Computer Science or related field

Tools

Power BI

Azure SQL

Fabric Data Pipelines

Dataflows Gen2

OneLake

Notebooks

Spark/PySpark

SQL Server

Azure Functions

Job description

About Us:

Artic Consulting is a dynamic IT and consulting services firm, delivering digital transformation through innovative solutions in data, cloud, and business analytics. We are seeking a skilledData Engineerwith a strong focus on theMicrosoft Fabric ecosystemand Application Databasemanagement, who can design and implement scalable data solutions for our clients.

Key Responsibilities:

• Hands-on experience building and maintaining OLTP databases, including relational data modeling, schema design, normalization, SQL query development, indexing, transaction handling, performance troubleshooting, and data integrity controls
• Design, develop, andmaintainPower BI reports, dashboards, DAX expressions, KPIs, and scorecards using both Import andDirectQuerymodes.
• Build and orchestrate scalable ETL/ELT workflows using Fabric Data Pipelines, Dataflows Gen2, and Azure Data Factory.
• Write and tune complex T-SQL and KQL queries, stored procedures, and views for performance in Synapse SQL and SQL Server environments.
• Implement data models based on star/snowflake schemas and support modern data warehousing and Lakehouse architectures using Microsoft Fabric.
• Manage andoptimizeAzure SQL application databases, including schema design, indexing strategies, stored procedures, query optimization, data integrity, security, monitoring, backup/recovery awareness, and operational reliability for client-facing business applications.
• Partner with application, analytics, and client teams to ensure Azure SQL transactional databases are performant, secure, well-structured, and ready for integration with reporting, data warehousing, Microsoft Fabric, and AI/ML workloads.
• integratestructured and unstructured data sources (e.g., SQL, Excel, APIs, Blob Storage), andtransform them efficiently using Fabric Notebooks (Spark/PySpark) or Dataflows.
• Diagnose and resolve pipeline failures, logic errors, and performance bottlenecks across the data engineering lifecycle.
• Automate repetitive data processes using Azure Functions, Logic Apps, PowerShell, or Python scripting within the Fabric ecosystem.
• Collaborate with stakeholders to gather business requirements and translate them into scalable data solutions.
• Ensure data governance, privacy, and compliance standards (e.g., GDPR, HIPAA, ISO) are adhered to, including sensitive data handling policies.
• Apply best practices for item-level security, workspace-based access models, and data lineage using MicrosoftOneLakeand Fabric tools.
• UtilisedAI-assisted tools such as GitHub Copilot and Microsoft Copilot to accelerate SQL development, data pipeline implementation, code reviews, troubleshooting, and performance optimization.
• Support AI initiatives by preparing, transforming, and managing high-quality datasets for model training and inference.
• Integrate AI-powered services such as Azure AI Services, Azure OpenAI, and Microsoft Fabric AI capabilities into data solutions.
• Develop andmaintaindata pipelines that support Generative AI, predictive analytics, and machine learning workloads.

Required Qualifications:

• Bachelor's or master'sdegree in computer science, Information Systems, or related field.
• Demonstrated hands‑on experience in Power BI development and data engineering, including building enterprise dashboards and semantic models, developing DAX calculations, implementing ETL/ELT pipelines, integrating multiple data sources,optimizingdata models and queries, and supporting production data workloads.
• Strongexpertisein T‑SQL and KQL, withdemonstratedquery optimization skills.
• Hands‑on experience managing Azure SQL Database environments, including performance tuning, index optimization, stored procedures, query troubleshooting, database security, and operational support for application workloads.
• Proficiencyin Microsoft Fabric tools: Data Pipelines, Dataflows Gen2,OneLake, Notebooks.
• Hands‑on experience with Spark/PySparkand data integration fromvariedsources.
• Microsoft Certified: Fabric Data Engineer Associate (DP‑700) – preferred for candidates specializing in Microsoft Fabric.
• Additional Microsoft certifications such as PL‑300 (Power BI Data Analyst Associate) or relevant Azure certifications are an advantage.

Preferred Skills:

• Experience debugging andoptimizingadvanced SQL queries, database objects, and legacy components.
• Ability to implement database security models and data protection policies.
• Experience using Azure SQL monitoring and tuning capabilities such as Query Store, Query Performance Insight, Database Advisor recommendations, and Azure portal metrics toidentifyand resolve performance bottlenecks.
• Expertisein implementing row‑level security, dynamic data masking, and role‑based access control within Microsoft Fabric and Power BI environments.
• Familiarity with MicrosoftOneLakearchitecture, including data cataloging, lineage tracking, item‑level security, and workspace‑based access management.
• Proven ability tooperateeffectively in dynamic, client‑facing environments, delivering scalable and compliant data solutions with a focus on performance and quality.

Why Join Artic Consulting?

• Competitive salary and performance-based bonuses.
• Flexible working hours and remote work options.
• Opportunities for professional development and certifications.
• Collaborative and inclusive work environment.
• Training budget for learning new skills and technologies.