Senior Data Engineer - Python Job

YASH Technologies; Bengaluru; On-site; INR 2,500,000 - 4,800,000; Full time

Benefits offered by this job

Flexible work arrangements

Culture of collaboration

Career development

Job summary

YASH Technologies is seeking a Senior Data Engineer to design and refine scalable data pipelines using Palantir Foundry, AWS, and Snowflake in Bengaluru. You will model data architectures, enforce governance, and collaborate with data scientists, analysts, and business stakeholders to deliver reliable analytics platforms.

The role emphasizes hands-on data engineering, performance optimization, and mentoring junior engineers within a modern data ecosystem at a leading technology integrator.

Qualifications

• 5-12 years of experience in data engineering or analytics.
• Strong hands-on with PySpark, Palantir Foundry, AWS.
• Proficient in Python, SQL, Snowflake.
• Experience with data integration, ETL, and data modelling principles.
• Experience with relational databases, data lakes, cloud data warehouses.

Responsibilities

• Design, implement, and maintain scalable data pipelines using Palantir Foundry and AWS.
• Collaborate with data scientists, analysts, and business stakeholders to translate data requirements into technical solutions.
• Build reusable data assets, integrate data from multiple sources, and ensure data quality, integrity and security.
• Develop and maintain transformation workflows, ontology models, and data governance in Foundry.
• Optimize data pipelines for performance, scalability, and cost efficiency.
• Troubleshoot, monitor, and resolve data issues in real-time.
• Implement best practices in data versioning, lineage, and observability.
• Assist in defining data architecture strategies and tooling roadmaps.
• Mentor junior engineers and contribute to team knowledge sharing.

Skills

PySpark

Palantir Foundry

AWS

Python

SQL

Data modelling

ETL pipelines

Data governance

CI/CD

Git

Communication

Tools

Snowflake

Job description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting‑edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

Job Description

Experience required: 5-12 years

We are seeking a highly motivated and technically skilled Senior Data Engineer with strong expertise in data pipeline development and advanced data modelling to join our data team. The ideal candidate will have extensive experience on designing, building, and refactoring scalable data pipelines and data models within a modern data engineering ecosystem using Palantir Foundry, AWS & Snowflake, along with broader expertise in data architecture, governance, and processing. This role offers the opportunity to work on cutting‑edge data platforms and deliver impactful solutions for enterprise data integration, transformation, and advanced analytics.

Key Responsibilities

• Design, implement, and maintain scalable and reliable data pipelines using Palantir Foundry, AWS
• Solid experience in web front‑end development, web‑services.
• Some exposure to business analytics, financial forecasting, or a related domain would be preferable.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
• Build reusable data assets, integrate data from multiple sources, and ensure data quality, integrity, and security.
• Develop and maintain transformation workflows, ontology models, and data governance frameworks within Foundry.
• Optimize data pipelines for performance, scalability, and cost efficiency.
• Troubleshoot, monitor, and resolve data issues and pipeline failures in real‑time.
• Implement best practices in data versioning, lineage, and observability.
• Assist in defining data architecture strategies and tooling roadmaps.
• Mentor junior engineers and contribute to team knowledge sharing and documentation.

Required Qualifications

• 5-12 years of experience in data engineering, analytics, or software engineering roles.
• Strong hands‑on experience with Pyspark, Palantir Foundry, AWS, including ontology modelling, pipelines, data fusion, and transformation logic.
• Proficient in Python, SQL, Snowflake and data processing frameworks.
• Solid understanding of data integration, ETL workflows, and data modelling principles.
• Experience working with relational databases, data lakes, cloud data warehouses (AWS, Azure, GCP, Snowflake, Web‑services).
• Strong problem‑solving skills and ability to debug complex data workflows.
• Familiarity with CI/CD pipelines and version control tools like Git.
• Excellent communication skills and ability to work collaboratively with cross‑functional teams.

Benefits

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self‑determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career‑oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.