Data Engineer - 2

Metayb; Chennai District; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Metayb is seeking a Senior Data Engineer to design, develop, and maintain scalable data solutions for BI, analytics, and decision-making. You will partner with stakeholders, analysts, and tech teams to build robust data pipelines and robust architectures across cloud platforms, with hands-on Microsoft Fabric experience.

The role emphasizes data governance, security, and continuous improvement, enabling enterprise-wide reporting and insights.

Qualifications

• Bachelor's degree in computer science, IT, engineering, or a related field.
• 5–8 years of experience in Data Engineering, Data Warehousing, or Analytics Engineering.
• 1+ year hands-on experience with Microsoft Fabric is mandatory.
• Strong experience with Azure data services and cloud platforms.
• Solid understanding of data modeling, ETL/ELT, data warehousing, and big data processing.
• Proficiency in SQL and Python for data engineering tasks.
• Experience designing scalable data architectures and data integration solutions.
• Strong analytical and problem-solving skills with excellent communication.
• Ability to manage stakeholders and deliver high-quality, reliable solutions.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes for analytics.
• Build and optimize data ingestion for structured, semi-structured, and unstructured data.
• Develop data models and architectures supporting enterprise reporting and analytics.
• Ensure data systems are scalable, secure, and reliable for large data volumes.
• Design modern data architectures aligned with business goals and tech objectives.
• Manage cloud-based data platforms, data warehouses, and lakehouse environments.
• Collaborate with architects and business teams to translate requirements into scalable solutions.
• Drive data governance, security, and performance optimization.

Skills

SQL

Python

Data modeling

ETL/ELT

Big data

Education

Bachelor's degree in CS/IT/Engineering/Data Science

Tools

Microsoft Fabric

Azure Data Services

Databricks

Synapse Analytics

Power BI

Job description

Metayb is a fast-growing digital transformation company empowering organizations to thrive in the digital-first era. In just three years, we've built a team of 500+ experts focused on creating seamless customer experiences, boosting operational efficiency, and delivering actionable insights. Our core strengths include Digital Transformation, Data Science, SAP Implementation, Workflow Automation, Finance, and Supply Chain Services, with aspirations to expand into IoT, AI/ML, and Virtual Reality.

By leveraging emerging technologies, Metayb aims to be a trusted global partner in delivering impactful, future-ready solutions.

Role Overview

As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining scalable data solutions that enable business intelligence, analytics, and data-driven decision-making. You will work closely with business stakeholders, data analysts, and technology teams to build robust data pipelines, optimize data architectures, and ensure the availability, quality, and security of enterprise data assets.

The ideal candidate will possess strong expertise in modern data engineering practices, cloud-based data platforms, and large-scale data processing frameworks, with hands‑on experience in Microsoft Fabric and Azure data services.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes to support analytics and reporting requirements.
• Build and optimize data ingestion frameworks for structured, semi-structured, and unstructured data sources.
• Develop efficient data models and architectures that support enterprise-wide reporting and analytics initiatives.
• Ensure data systems are scalable, secure, reliable, and capable of handling large volumes of data.
• Design and implement modern data architectures aligned with business and technology objectives.
• Manage and optimize cloud-based data platforms, data warehouses, and lakehouse environments.
• Collaborate with solution architects and business teams to translate requirements into scalable technical solutions.
• Drive best practices in data governance, security, and performance optimization.

3. Data Quality & Governance

• Implement data quality checks, validation frameworks, and monitoring mechanisms to ensure data accuracy and integrity.
• Establish standards and processes for data management, lineage, and governance.
• Troubleshoot and resolve data inconsistencies, performance bottlenecks, and system issues.
• Ensure compliance with organizational and regulatory data management standards.

4. Analytics Enablement & Business Support

• Work closely with business intelligence, analytics, and data science teams to enable advanced reporting and insights generation.
• Analyze complex datasets to identify trends, patterns, and opportunities that support strategic business decisions.
• Support the development of dashboards, KPIs, and self-service analytics capabilities.
• Provide technical guidance and recommendations to stakeholders on data-related initiatives.
• Stay updated with emerging technologies, tools, and trends in data engineering, cloud analytics, and big data ecosystems.
• Evaluate and recommend new technologies that enhance scalability, efficiency, and business value.
• Drive automation and process improvements to improve data delivery and operational excellence.
• Contribute to the continuous evolution of Metayb’s data engineering capabilities and best practices.

Qualifications

• Bachelor's degree in computer science, Information Technology, Engineering, Data Science, or a related field.
• 5-8 years of relevant experience in Data Engineering, Data Warehousing, or Analytics Engineering.
• Minimum 1+ year of hands‑on experience with Microsoft Fabric is mandatory.
• Strong experience working with Azure data services and cloud-based data platforms.
• Strong understanding of data engineering principles including data modeling, ETL/ELT frameworks, data warehousing, and big data processing.
• Proficiency in SQL and Python for data engineering and analytics use cases.
• Experience designing and implementing scalable data architectures and data integration solutions.
• Strong analytical and problem-solving skills with the ability to manage complex technical challenges.
• Excellent communication and stakeholder management skills.
• High attention to detail and commitment to delivering high-quality, reliable solutions.

Technical Skills

Mandatory Skills

• Microsoft Fabric (Minimum 1+ year of hands‑on experience).
• Azure Data Services and Cloud Data Platforms.
• SQL Development and Query Optimization.
• Python Programming.
• Data Modeling and Data Warehousing.
• Data Integration and Data Quality Management.

Preferred Skills

• Databricks.
• Synapse Analytics.
• Power BI.
• Big Data Processing Frameworks and Lakehouse Architectures.
• Data Governance and Security Best Practices.

Disclaimer: The job title mentioned in this description is generic and intended for broad categorization purposes. The final designation will be determined based on the candidate's performance during the interview process, relevant experience, and alignment with the organizational hierarchy.