Senior Data Engineer - Python Job

YASH Technologies; Bengaluru; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

YASH Technologies is hiring a Senior Data Engineer for the iConnect Suggestions project in Bengaluru. You will build and maintain a scalable data engineering platform generating intelligent suggestions for pharma sales reps, with cross-country deployment in mind.

The role emphasizes reusable modules, object-oriented design, and collaboration within agile teams, including CRM migration support and data pipeline improvements.

Qualifications

• Advanced Python programming with data manipulation using pandas.
• Strong OOP and design pattern knowledge.
• Experience with AWS data services (Glue, Athena, DynamoDB).
• Familiarity with AWS Step Functions and Lambda.
• Understanding of cloud architectures and Agile methodologies.

Responsibilities

• Develop and maintain a scalable data engineering platform for pharma sales suggestions.
• Build reusable modules across multiple countries and business settings.
• Collaborate in agile teams to deliver high-quality solutions on schedule.
• Support migration of the platform to a new CRM system, including validation tasks.
• Debug and fix issues in data pipelines and workflows.

Skills

Python

pandas

OOP

AWS

Glue

Athena

DynamoDB

Step Functions

Lambda

Azure DevOps

Tools

Python development tools

Job description

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we’re a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire Python Professionals in the following areas :

Job Description

Experience required: 5-10 years.

Senior Data Engineer – iConnect Suggestions Project

The Role

The Senior Data Engineer for the iConnect Suggestions project will be responsible for maintaining and developing a comprehensive Data Engineering platform that generates intelligent suggestions for pharma sales representatives. This role focuses on building scalable, reusable solutions that can be deployed across multiple countries and business environments within the project framework.

Key Responsibilities

• Develop and maintain the Data Engineering platform that powers suggestion generation for pharma sales representatives
• Design and implement generalized modules using modern Python development practices that are reusable across various countries and business settings
• Apply object-oriented programming principles to create maintainable and scalable data processing solutions
• Collaborate effectively within agile development teams to deliver high-quality solutions on schedule
• Support the migration of the suggestion generation platform to a new CRM system, including setup activities such as use case pipeline updates, validation through end-to-end run checks and suggestion validation, and execution of migration tasks
• Identify root causes of issues with existing data and suggestion generation pipelines and implement robust fixes (debugging across AWS Step Functions, Glue, Athena, and Lambda)
• Leverage modern Python development tools and engineering practices to ensure code quality, testing, and deployment efficiency

Who We Are Looking For

Required Skills & Experience

• Advanced Python programming expertise, with particular strength in:
  • pandas for data manipulation and analysis
  • Object-oriented programming (OOP) principles and design patterns
  • Modern Python development tools and best practices
• AWS cloud technologies experience, specifically:
  • AWS Glue for ETL processes
  • Amazon Athena for data querying
  • DynamoDB for NoSQL data storage
  • AWS Step Functions and Lambda for workflow orchestration
• Strong understanding of cloud architectures, particularly AWS-based solutions
• Experience with agile software development methodologies and common project management tools (e.g., Azure DevOps)
• 5-10 years of data engineering experience with global or regional project exposure

Nice to Have

• Basic knowledge of Veeva platforms
• Experience with modern software engineering practices including CI/CD, version control, and automated testing
• Background in pharmaceutical or healthcare data environments

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture