Senior Data Engineer

Talent Corner HR Services Pvt Ltd; Ahmedabad District; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Talent Corner HR Services Pvt Ltd is seeking a Sr. Data Engineer to join their Data Analytics team. You will be involved in designing and implementing scalable data platforms, building robust data pipelines, and empowering stakeholders with actionable insights.

The ideal candidate should have over 5 years of experience in data engineering, strong proficiency in Azure Cloud and Python, and the ability to create data-driven solutions in a dynamic environment.

Qualifications

• 5+ years of experience in a data engineering role.
• Strong proficiency in Azure Cloud concepts, Python (PySpark), and SQL for large-scale data transformation.
• Experience building dashboards and reports using Power BI or similar visualization tools.

Responsibilities

• Architect, maintain, and optimize scalable data pipelines.
• Build and maintain pipelines in Azure Data Factory and/or Azure Synapse Analytics Pipelines.
• Monitor pipeline health and costs using Azure Monitor.

Skills

Azure Cloud concepts

Python (PySpark)

SQL

Power BI

Data Factory

Azure Synapse Analytics

AWS services

dbt

Orchestration tools (ETL)

Education

Bachelor’s degree in Computer Science, Data Science, Mathematics, or a related field

Job description

We are seeking a Sr. Data Engineer to join our growing Data Analytics team. In this role, you will design and implement scalable data platforms that enable data-driven decision-making across the company. You will build robust data pipelines, reporting solutions, and data products that empower stakeholders with actionable insights.

Key Responsibilities

• Architect, maintain, and optimize scalable data pipelines, leveraging Azure Data Services, Azure DevOps, and select AWS components.
• Build and maintain pipelines in Azure Data Factory and/or Azure Synapse Analytics Pipelines.
• Monitor pipeline health and costs using Azure Monitor, Log Analytics, and custom dashboards.
• Assemble and manage large, complex datasets that meet functional and non-functional business requirements.
• Implement and maintain data quality frameworks using tools such as dbt tests and monitoring solutions.
• Collaborate with business intelligence analysts, data scientists and business stakeholders to understand requirements and deliver tailored solutions.
• Develop and maintain technical documentation, workflows, and best practices to ensure knowledge sharing across teams.
• Provide support for data-related incidents and participate in an on-call rotation when necessary.
• Demonstrate willingness to explore and learn new technologies and tools as our data ecosystem evolves and show enthusiasm for adopting upcoming technologies.

Skills, Knowledge & Expertise

• 5+ years of experience in a data engineering role, ideally within a consumer-focused or technology-driven organization.
• Strong proficiency in Azure Cloud concepts, Python (PySpark), and SQL for large-scale data transformation.
• Experience building dashboards and reports using Power BI (preferred), Tableau, or similar visualization tools.
• Proven ability to design and execute complex data pipelines for large-scale datasets.
• Ability to translate business strategies into technical requirements and deliver practical solutions.
• Creative problem-solver with a strong understanding of analytics use cases and the data required to support them.
• Hands-on experience with Azure Data Services (Data Factory, Synapse, etc.), Azure DevOps, and familiarity with AWS services.
• Experience with dbt, orchestration tools (e.g. ETL), and modern data warehousing platforms.
• Success working in fast-paced, dynamic environments with evolving priorities.
• Bachelor’s degree in Computer Science, Data Science, Mathematics, or a related quantitative field preferred.