Sr. Software Engineer - Python + Palantir Job

YASH Technologies, Inc.; Bengaluru; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

YASH Technologies invites a Senior Data Engineer to join our data team in Bengaluru. You will design, build, and refine scalable data pipelines and data models within a modern data ecosystem using Palantir Foundry, AWS, and Snowflake.

The role requires 5-12 years of experience in data engineering or related fields, strong Python/SQL skills, and a focus on data governance and observability. You will mentor peers and contribute to enterprise data integration and analytics initiatives.

Qualifications

• 5-12 years of experience in data engineering, analytics, or software engineering roles.
• Strong hands-on experience with PySpark, Palantir Foundry, AWS, including ontology modelling, pipelines, data fusion, and transformation logic.
• Proficient in Python, SQL, Snowflake and data processing frameworks.
• Solid understanding of data integration, ETL workflows, and data modelling principles.
• Experience working with relational databases, data lakes, cloud data warehouses (AWS, Azure, GCP, Snowflake, Web-services).
• Strong problem-solving skills and ability to debug complex data workflows.
• Familiarity with CI/CD pipelines and version control tools like Git.
• Excellent communication skills and ability to work collaboratively with cross-functional teams.

Responsibilities

• Design, implement, and maintain scalable and reliable data pipelines using Palantir Foundry, AWS.
• Build data models and ontologies for enterprise data needs.
• Collaborate with data scientists and stakeholders to translate requirements into solutions.
• Develop reusable data assets and ensure data quality, integrity, and security.
• Optimize pipelines for performance, scalability, and cost efficiency.
• Monitor and troubleshoot data issues and pipeline failures in real time.
• Implement best practices in data versioning, lineage, and observability.
• Contribute to data architecture strategies and tooling roadmaps.
• Mentor junior engineers and share knowledge across the team.
• Work in an agile environment with cross-functional collaboration.

Skills

PySpark

Palantir Foundry

AWS

Python

SQL

Snowflake

ETL

Data modeling

Data integration

Git

CI/CD

Tools

Git

Job description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth - bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hirePython Professionals in the following areas :

Experience required: 5-12 years

We are seeking a highly motivated and technically skilled Senior Data Engineer with strong expertise in data pipeline development and advanced data modelling to join our data team. The ideal candidate will have extensive experience on designing, building, and refactoring scalable data pipelines and data models within a modern data engineering ecosystem using Palantir Foundry, AWS & Snowflake, along with broader expertise in data architecture, governance, and processing. This role offers the opportunity to work on cutting-edge data platforms and deliver impactful solutions for enterprise data integration, transformation, and advanced analytics.

Key Responsibilities:

• Design, implement, and maintain scalable and reliable data pipelines using Palantir Foundry, AWS.
• Solid experience in web front-end development, web-services.
• Some exposure to business analytics, financial forecasting, or a related domain would be preferable.
• Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and translate them into technical solutions.
• Build reusable data assets, integrate data from multiple sources, and ensure data quality, integrity, and security.
• Develop and maintain transformation workflows, ontology models, and data governance frameworks within Foundry.
• Optimize data pipelines for performance, scalability, and cost efficiency.
• Troubleshoot, monitor, and resolve data issues and pipeline failures in real-time.
• Implement best practices in data versioning, lineage, and observability.
• Assist in defining data architecture strategies and tooling roadmaps.
• Mentor junior engineers and contribute to team knowledge sharing and documentation.

Required Qualifications:

• 5-12 years of experience in data engineering, analytics, or software engineering roles.
• Strong hands-on experience with Pyspark, Palantir Foundry, AWS, including ontology modelling, pipelines, data fusion, and transformation logic.
• Proficient in Python, SQL, Snowflake and data processing frameworks.
• Solid understanding of data integration, ETL workflows, and data modelling principles.
• Experience working with relational databases, data lakes, cloud data warehouses (AWS, Azure, GCP, Snowflake, Web-services).
• Strong problem-solving skills and ability to debug complex data workflows.
• Familiarity with CI/CD pipelines and version control tools like Git.
• Excellent communication skills and ability to work collaboratively with cross-functional teams.

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment.We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture

Location

Bangalore, KA, IN