Senior Data Engineer

Parable Associates; Mumbai; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Parable Associates seeks a seasoned data engineer to design and optimize cloud-native data pipelines that deliver reliable, timely insights for clients. You will partner with internal teams and clients to build scalable architectures on Microsoft Fabric and related cloud platforms, guiding data ingestion, transformation, and governance from source to lakehouse.

The role emphasizes data quality, security, performance tuning, and mentoring junior engineers to promote best practices across the data

Qualifications

• 5+ years of experience in data engineering or a similar role, with a focus on cloud-native technologies.
• Experience in Microsoft Fabric or Azure Data Factory, with hands-on experience designing data pipelines.
• Experience using PySpark in big data processing and transformation.
• Strong understanding of data modeling, ETL and ELT processes, and building data warehousing solutions.
• Strong knowledge of modern data architecture principles and best practices.
• Excellent problem-solving skills with the ability to troubleshoot complex data challenges.

Responsibilities

• Design, develop, and maintain scalable, secure, and high-performing data pipelines using Microsoft Fabric, Azure Data Factory, PySpark, and Databricks.
• Create and manage data pipelines to ingest, process, and transform data from various sources into the lakehouse.
• Collaborate with data architects, business analysts, and other stakeholders to understand data requirements and translate them into scalable solutions.
• Build and optimize data models and data warehousing solutions to support business intelligence and advanced analytics, implementing techniques such as dimensional modeling, normalization, creating surrogate keys, utilizing Slowly Changing Dimensions, partitioning, and aggregation.
• Perform data transformation and pipeline orchestration using Fabric Notebooks to cleanse and prepare data for report consumption.
• Implement and maintain security measures to protect data assets
• Ensure data quality, integrity, and governance across all stages of the data lifecycle.
• Optimize performance of data ingestion, transformation, and loading processes.
• Proactively identify areas for process improvement, automation, and cost efficiency within the data pipeline infrastructure.
• Provide technical mentorship to junior engineers and collaborate on the adoption of best practices in data engineering.
• Maintain comprehensive documentation of data systems, processes, and workflows.

Skills

Data engineering

Cloud data platforms

Education

Bachelor's degree in CS/IS

Tools

Microsoft Fabric

Azure Data Factory

PySpark

Databricks

Job description

Are you excited about building the future of data solutions and leveraging cutting-edge cloud technologies? At Parable Associates, you’ll be at the forefront of developing and optimizing data pipelines that drive impactful insights for our clients. You'll do more than just develop data solutions—you’ll be a key partner in shaping how organizations utilize their data to drive innovation and success.

In this role, you'll work closely with both internal teams and clients to design and implement cloud-based data architectures using Microsoft Fabric and similar cloud platforms. You’ll guide the process from data ingestion to transformation and ensure data quality, governance, and efficiency. If you're passionate about solving complex challenges, have a strong understanding of cloud data platforms, and are eager to make an impact, we’d love to have you join our team.

RESPONSIBILITIES

• Design, develop, and maintain scalable, secure, and high-performing data pipelines using Microsoft Fabric, Azure Data Factory, PySpark, and Databricks.
• Create and manage data pipelines to ingest, process, and transform data from various sources into the lakehouse.
• Collaborate with data architects, business analysts, and other stakeholders to understand data requirements and translate them into scalable solutions.
• Build and optimize data models and data warehousing solutions to support business intelligence and advanced analytics, implementing techniques such dimensional modeling, normalization, creating surrogate keys, utilizing Slowly Changing Dimensions, partitioning, and aggregation.
• Perform data transformation and pipeline orchestration using Fabric Notebooks to cleanse and prepare data for report consumption.
• Implement and maintain security measures to protect data assets
• Ensure data quality, integrity, and governance across all stages of the data lifecycle.
• Optimize performance of data ingestion, transformation, and loading processes.
• Proactively identify areas for process improvement, automation, and cost efficiency within the data pipeline infrastructure.
• Provide technical mentorship to junior engineers and collaborate on the adoption of best practices in data engineering.
• Maintain comprehensive documentation of data systems, processes, and workflows.

RESULTS

• Reliable, efficient data pipelines that deliver clean, timely data to stakeholders.
• Scalable, high-performance data platforms that meet client requirements for analytics and reporting.
• Streamlined data workflows that improve time-to-insight for business intelligence initiatives.
• High client satisfaction through seamless data solutions that solve complex challenges.

REQUIREMENTS

• 5+ years of experience in data engineering or a similar role, with a focus on cloud-native technologies.
• Experience in Microsoft Fabric or Azure Data Factory, with hands-on experience designing data pipelines.
• Experience using PySpark in big data processing and transformation
• Strong understanding of data modeling, ETL and ELT processes, and building data warehousing solutions.
• Strong knowledge of modern data architecture principles and best practices.
• Excellent problem-solving skills with the ability to troubleshoot complex data challenges.
• Bachelor’s degree in computer science, information systems, or a related field.
• Highlight motivated, self-starter who can work independently and take initiative to drive projects forward

PREFERRED

• Experience with cloud platforms such as Microsoft Azure.
• Familiarity with Power BI for data visualization and reporting.
• Knowledge of data governance and security best practices.

ABOUT THE COMPANY

At Parable Associates, we specialize in transforming complex data into clear, actionable insights for our clients across various industries. We’re not just another business intelligence company; we’re storytellers, turning data into meaningful narratives that empower organizations to make informed decisions faster. Our innovative approach, combined with a passion for results, makes us the trusted partner for organizations seeking to optimize their data operations and unlock new insights.