Fabric Data engineer

KPI Partners; Bengaluru Urban; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

KPI Partners is seeking a Senior Fabric Data Engineer to design, implement, and maintain our data infrastructure for advanced analytics. You will build data pipelines, ETL processes, and data models, collaborating with scientists, analysts, and stakeholders to ensure data quality and accessibility.

You will optimize architectures for performance and scalability while upholding governance and security standards.

Qualifications

• Develop and maintain data pipelines and ETL processes.
• Collaborate with data scientists, analysts and stakeholders.
• Optimize data architectures for performance and scalability.
• Implement data governance, security and compliance practices.
• Troubleshoot data-related issues promptly.
• Participate in architecture discussions and design decisions.
• Stay updated with industry trends in data engineering.

Responsibilities

• Develop and maintain data pipelines and ETL processes to support data ingestion and transformation across multiple sources.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality and accessibility.
• Optimize existing data architectures for performance, scalability, and reliability.
• Implement best practices for data governance, security, and compliance within the data ecosystem.
• Troubleshoot and resolve data-related issues in a timely manner.
• Participate in architecture discussions and contribute to technical design decisions.
• Stay updated with industry trends and emerging technologies related to data engineering and analytics.

Skills

SQL

Data pipelines

ETL processes

Apache Spark

Hadoop

Distributed processing

Data warehousing

Azure

Microsoft Fabric

Data integration

Data governance

Problem solving

Communication

Tools

Apache Spark

Hadoop

Microsoft Fabric

Azure

Job description

KPI Partners is seeking a highly skilled and motivated Senior Fabric Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining our data infrastructure to support our growing analytics capabilities.

Key Responsibilities:

• Develop and maintain data pipelines and ETL processes to support data ingestion and transformation across multiple sources.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and ensure data quality and accessibility.
• Optimize existing data architectures for performance, scalability, and reliability.
• Implement best practices for data governance, security, and compliance within the data ecosystem.
• Troubleshoot and resolve data-related issues in a timely manner.
• Participate in architecture discussions and contribute to technical design decisions.
• Stay updated with industry trends and emerging technologies related to data engineering and analytics.
• Proven experience as a Data Engineer or similar role, with a focus on data integration and engineering practices and Good Hands on experience on Microsoft fabric
• Strong proficiency in SQL and experience with data manipulation tools and frameworks.
• Expertise in distributed data processing frameworks like Apache Spark, Hadoop, or similar technologies.
• Familiarity with data warehousing solutions
• Experience with cloud platforms like Azure,
• Strong analytical and problem-solving skills, with attention to detail.
• Excellent communication and collaboration skills to work effectively in a team environment.