Senior Data Engineer

SCALIS; Pune District; On-site; INR 2,400,000 - 3,600,000; Full time

Job summary

Parable Associates is seeking a data engineer to design, build, and optimize cloud-native data pipelines using Microsoft Fabric and Azure Data Factory. You will work with internal teams and clients to deliver scalable lakehouse solutions and ensure data quality and governance.

The ideal candidate has 5+ years in data engineering, strong PySpark experience, data modeling, and hands-on skills with Databricks and Power BI.

Qualifications

• 5+ years of experience in data engineering with cloud-native technologies.
• Experience with Microsoft Fabric or Azure Data Factory and building data pipelines.
• Strong knowledge of data modeling, ETL/ELT, and data warehousing.
• Familiarity with data governance and security best practices.
• Proactive, self-motivated and able to mentor junior engineers.

Responsibilities

• Design, develop, and maintain scalable, secure data pipelines using Microsoft Fabric, Azure Data Factory, PySpark, and Databricks.
• Ingest, process, and transform data from multiple sources into the lakehouse.
• Collaborate with data architects and stakeholders to translate data requirements into scalable solutions.
• Build and optimize data models and data warehousing solutions for BI and analytics, including dimensional modeling and surrogate keys.
• Perform data transformation and orchestration using Fabric Notebooks.
• Implement and maintain data security measures across the data lifecycle.

Skills

Cloud data engineering

PySpark

Data modeling

ETL/ELT design

Data warehousing

Azure data services

Problem solving

Independent work

Education

Bachelor’s degree in computer science or related field

Tools

Microsoft Fabric

Azure Data Factory

Databricks

Power BI

Job description

ROLE

Are you excited about building the future of data solutions and leveraging cutting‑edge cloud technologies? At Parable Associates, you’ll be at the forefront of developing and optimizing data pipelines that drive impactful insights for our clients. You’ll do more than just develop data solutions—you’ll be a key partner in shaping how organizations utilize their data to drive innovation and success.

In this role, you'll work closely with both internal teams and clients to design and implement cloud‑based data architectures using Microsoft Fabric and similar cloud platforms. You’ll guide the process from data ingestion to transformation and ensure data quality, governance, and efficiency. If you're passionate about solving complex challenges, have a strong understanding of cloud data platforms, and are eager to make an impact, we’d love to have you join our team.

RESPONSIBILITIES

• Design, develop, and maintain scalable, secure, and high‑performing data pipelines using Microsoft Fabric, Azure Data Factory, PySpark, and Databricks.
• Create and manage data pipelines to ingest, process, and transform data from various sources into the lakehouse.
• Collaborate with data architects, business analysts, and other stakeholders to understand data requirements and translate them into scalable solutions.
• Build and optimize data models and data warehousing solutions to support business intelligence and advanced analytics, implementing techniques such as dimensional modeling, normalization, creating surrogate keys, utilizing Slowly Changing Dimensions, partitioning, and aggregation.
• Perform data transformation and pipeline orchestration using Fabric Notebooks to cleanse and prepare data for report consumption.
• Implement and maintain security measures to protect data assets.
• Ensure data quality, integrity, and governance across all stages of the data lifecycle.
• Optimize performance of data ingestion, transformation, and loading processes.
• Proactively identify areas for process improvement, automation, and cost efficiency within the data pipeline infrastructure.
• Provide technical mentorship to junior engineers and collaborate on the adoption of best practices in data engineering.
• Maintain comprehensive documentation of data systems, processes, and workflows.

RESULTS

• Reliable, efficient data pipelines that deliver clean, timely data to stakeholders.
• Scalable, high‑performance data platforms that meet client requirements for analytics and reporting.
• Streamlined data workflows that improve time‑to‑insight for business intelligence initiatives.
• High client satisfaction through seamless data solutions that solve complex challenges.

REQUIREMENTS

• 5+ years of experience in data engineering or a similar role, with a focus on cloud‑native technologies.
• Experience in Microsoft Fabric or Azure Data Factory, with hands‑on experience designing data pipelines.
• Experience using PySpark in big data processing and transformation.
• Strong understanding of data modeling, ETL and ELT processes, and building data warehousing solutions.
• Strong knowledge of modern data architecture principles and best practices.
• Excellent problem‑solving skills with the ability to troubleshoot complex data challenges.
• Bachelor’s degree in computer science, information systems, or a related field.
• Motivated, self‑starter who can work independently and take initiative to drive projects forward.

PREFERRED

• Experience with cloud platforms such as Microsoft Azure.
• Familiarity with Power BI for data visualization and reporting.
• Knowledge of data governance and security best practices.