Senior Software Engineer

McKesson Compile; Bengaluru; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

McKesson Compile India Private Limited; Bangalore-based senior software engineer role focusing on designing, developing, and maintaining scalable data pipelines and web crawling systems. You will contribute to the full software development lifecycle, ensuring high-quality, secure applications and effective data processing.

The role requires 2+ years of experience in software development, with strong Python expertise and hands-on experience in Spark, SQL, databases, cloud platforms, and CI/CD

Qualifications

• 2+ years of professional software development experience.
• Proficiency in Python.
• Strong knowledge of data structures, OOP and design patterns.
• Proficient in building scalable data pipelines using Spark/PySpark.
• Proficient in writing complex SQL queries (CTEs, joins, window functions).
• Experience with Airflow or Prefect.
• Experience with relational/NoSQL databases (PostgreSQL, Snowflake).
• Experience with cloud platforms (AWS, Azure, GCP).
• Proficient with Git/Git workflows (Git-flow a plus).
• Experience implementing web crawlers using Scrapy and Python is a plus.

Responsibilities

• Design and implement scalable data pipelines aligned with business requirements.
• Design and build web crawlers using Scrapy and Python.
• Own and deliver medium to large features and technical initiatives.
• Participate in technical design discussions and estimate development effort.
• Define and implement automated testing, data quality checks, and monitoring capabilities.
• Troubleshoot production issues, perform root cause analysis, and implement preventive solutions.
• Optimize application, database, and pipeline performance, scalability, and cost.
• Contribute to CI/CD, automation, observability, and operations initiatives.
• Review peer code and promote engineering best practices.

Skills

Python

Data structures

OOP

Design patterns

PySpark/Apache Spark

SQL

Airflow/Prefect

Databases (PostgreSQL/Snowflake)

Cloud platforms (AWS/Azure/GCP)

Git/Git workflows

Scrapy

Data pipelines

Education

Bachelor's or Master's in Computer Science/Software Engineering or related

Tools

Scrapy

GitHub/GitLab

Job description

About McKesson Compile

Established in 1833, McKesson is a US Fortune 10 global leader in healthcare supply chain management solutions, retail pharmacy, healthcare technology, community oncology, and specialty care. We partner with life sciences companies, manufacturers, providers, pharmacies, governments, and other healthcare organizations to help provide the right medicines, medical products, and healthcare services to the right patients at the right time, safely and cost effectively.

Based in Bangalore India, McKesson Compile’s data is a comprehensive, full linked system of record for the US Healthcare market, with intelligence on 2M+ healthcare professionals (HCPs) and over 800K facilities. Compile’s data includes high capture medical and pharmacy claims, closed capture Medicare claims (100%), along with best-in-class provider affiliations and customer master. At McKesson we deliver careers with purpose and potential. Our focus on better health starts with creating an inclusive environment with strong values where you can build a fulfilling career. You can count on us to provide you with resources and opportunities to grow and be your best, while contributing to our pursuit of improving lives.

We are seeking a highly skilled and experienced Senior Software Engineer to join our innovative team at McKesson Compile India Private Limited. In this role, you will be instrumental in designing, developing, and maintaining complex software solutions that drive our business forward. You will contribute to the full software development lifecycle, ensuring high-quality, scalable, and secure applications.

Key Responsibilities

• Design and implement scalable and maintainable data pipelines aligned with business requirements
• Design and build web crawlers using Scrapy and python.
• Independently own and deliver medium to large features, enhancements, and technical initiatives.
• Participate in technical design discussions, evaluate implementation alternatives, and estimate development effort.
• Define and implement automated testing, data quality checks, and monitoring capabilities.
• Troubleshoot production issues, perform root cause analysis, and implement preventive solutions.
• Optimize application, database, and pipeline performance, scalability, reliability, and cost efficiency.
• Contribute to CI/CD, automation, observability, and operational excellence initiatives.
• Review peer code and promote engineering best practices across the team.

Minimum Requirement

Degree or equivalent and typically requires 2+ years of relevant experience.

Education

Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field.

Basic/Critical Skills

• 2+ years of professional experience in software development, with a proven track record of delivering high-quality software solutions.
• Strong proficiency in at least one modern programming language such as Python.
• Strong knowledge of data structures, object-oriented programming principles and design patterns.
• Proficient in building scalable data pipelines using Apache spark or PySpark.
• Proficient in writing complex SQL queries, CTE’s, joins and window function for data transformations
• Experience in orchestrating complex workflows using tools like Apache Airflow or Prefect.
• Experience with relational and/or NoSQL databases (e.g., PostgreSQL, Snowflake).
• Experience with cloud platforms (e.g., AWS, Azure, GCP), data platforms and distributed systems.
• Proficient with GitLab/GitHub, Git CLI and working with team workflows like Git-flow is a plus.
• Experience in implementing web-crawlers using Scrapy and Python is a plus.

Preferred Skills

• Experience implementing CI/CD for data pipelines with automated testing and data quality checks is a plus.
• Familiarity with microservices architecture, RESTful APIs, and distributed systems.
• Excellent problem-solving, analytical, and communication skills.
• Ability to work independently and collaboratively in a fast-paced, dynamic environment.
• Experience with healthcare domain knowledge is a plus.