Senior Data Engineer, Digital Products

BioSpace; Chittoor; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

The U.S. Pharmacopeial Convention (USP) is seeking a Data Engineer to build robust data pipelines, manage large-scale data infrastructure, and enable advanced analytics. This role supports initiatives to protect patient safety and improve health outcomes worldwide.

You will design scalable data architectures, collaborate with data scientists, and work with AWS services and BI tools such as Tableau and Power BI, to deliver trusted data for stakeholders.

Qualifications

• Bachelor's degree in relevant field (e.g. Engineering, Analytics or Data Science, Computer Science, Statistics) or equivalent experience.
• 3+ years of experience in big data technologies such as Python, PySpark, and SQL for processing structured, semi-structured, and unstructured data.
• Hands-on experience with AWS data services including Redshift, S3, Glue, Lambda, EventBridge, Postgres; Exposure to Graph databases such as Neo4j is preferred.
• Experience in building batch, micro-batch, and streaming pipelines (real-time / near real-time) using Lambda/Kappa architectures.
• Hands-on expertise in designing and delivering enterprise-scale data platforms, including data lakehouse, data warehouse, data lake, and data marts.
• Understanding data modeling techniques including - Data Vault 2.0, Dimensional Modeling, Knowledge Graphs is a plus
• Experience with medallion architecture and metadata-driven data pipeline frameworks.
• Experience in data governance frameworks, including- Data discovery, Data quality, Data security
• Strong SQL and programming skills for data transformation, modeling, and analysis.
• Hands-on experience in building and maintaining complex ETL/ELT pipelines and managing day-to-day data operations.
• Experience with workflow orchestration tools such as Airflow.
• Knowledge of streaming/event-driven architectures and modern data processing patterns.
• Good understanding of dashboarding and visualization techniques with tools like Tableau, Power BI, or equivalent.
• Experience with Agile (SAFe) methodologies, CI/CD pipelines, and modern deployment practices for data platforms.

Responsibilities

• Implement scalable data collection, storage, and processing pipelines to support enterprise-wide data needs.
• Implement and maintain data governance frameworks and data quality checks within data pipelines to ensure compliance and reliability.
• Build and optimize data models and data marts to support self-service analytics and reporting tools such as Tableau, Looker, and Power BI
• Partner with data scientists to operationalize models by integrating them into production-grade pipelines, ensuring scalability, performance, and maintainability.
• Collaborate with cross-functional stakeholders (business, product, analytics, and engineering teams) to translate business requirements into scalable data solutions and prioritize data initiatives.
• Collaborate with platform, DevOps, and security teams to ensure secure, cost-effective, and scalable data infrastructure.

Skills

Python

PySpark

SQL

Airflow

Tableau

Power BI

Education

Bachelor's degree

Tools

AWS Redshift

AWS S3

AWS Glue

AWS Lambda

AWS EventBridge

Postgres

Neo4j

Job description

Description

The U.S. Pharmacopeial Convention (USP) USP is an independent scientific organization that collaborates with the world's top experts in health and science to develop quality standards for medicines, dietary supplements, and food ingredients. USP's fundamental belief that Equity = Excellence manifests in our core value of Passion for Quality through our more than 1,100 talented professionals across five global locations to deliver the mission to strengthen the supply of safe, quality medicines and supplements worldwide.

Brief Job Overview

The Digital product engineering team at USP is seeking a Data Engineer with expertise in building robust data pipelines, managing large-scale data infrastructure, and enabling advanced analytics capabilities. This role is critical to supporting projects that align with our mission to protect patient safety and improve the health of people around the world. We are looking for a professional who understands the value of clean, accessible, and well‑organized data, and who enjoys designing systems that empower data scientists, analysts, and business stakeholders to derive actionable insights. The ideal candidate will be passionate about data architecture, cloud technologies, and scalable engineering solutions that drive innovation and impact.

How will YOU create impact here at USP?

The position's purpose should provide a high-level overview of why the position exists and briefly identify the most critical priorities of the position. This is an opportunity to highlight any features or duties of the role related explicitly to the Diversity, Equity, Inclusion & Belonging work of the Department.

• Implement scalable data collection, storage, and processing pipelines to support enterprise-wide data needs.


• Implement and maintain data governance frameworks and data quality checks within data pipelines to ensure compliance and reliability.


• Build and optimize data models and data marts to support self‑service analytics and reporting tools such as Tableau, Looker, and Power BI


• Partner with data scientists to operationalize models by integrating them into production‑grade pipelines, ensuring scalability, performance, and maintainability.


• Collaborate with cross‑functional stakeholders (business, product, analytics, and engineering teams) to translate business requirements into scalable data solutions and prioritize data initiatives.


• Collaborate with platform, DevOps, and security teams to ensure secure, cost‑effective, and scalable data infrastructure.

Who USP is Looking For?

The Successful Candidate Will Have a Demonstrated Understanding Of Our Mission, Commitment To Excellence Through Inclusive And Equitable Behaviors And Practices, Ability To Quickly Build Credibility With Stakeholders, Along With The Following Competencies And Experience

Education

Bachelor’s degree in relevant field (e.g. Engineering, Analytics or Data Science, Computer Science, Statistics) or equivalent experience.

Experience

• 3+ years of experience in big data technologies such as Python, PySpark, and SQL for processing structured, semi‑structured, and unstructured data.


• Hands‑on experience with AWS data services including Redshift, S3, Glue, Lambda, EventBridge, Postgres; Exposure to Graph databases such as Neo4j is preferred.


• Experience in building batch, micro‑batch, and streaming pipelines (real-time / near real‑time) using Lambda/Kappa architectures.


• Hands‑on expertise in designing and delivering enterprise‑scale data platforms, including data lakehouse, data warehouse, data lake, and data marts.


• Understanding data modeling techniques including - Data Vault 2.0, Dimensional Modeling, Knowledge Graphs is a plus


• Experience with medallion architecture and metadata‑driven data pipeline frameworks.


• Experience in data governance frameworks, including- Data discovery, Data quality, Data security


• Strong SQL and programming skills for data transformation, modeling, and analysis.


• Hands‑on experience in building and maintaining complex ETL/ELT pipelines and managing day‑to‑day data operations.


• Experience with workflow orchestration tools such as Airflow.


• Knowledge of streaming/event‑driven architectures and modern data processing patterns.


• Good understanding of dashboarding and visualization techniques with tools like Tableau, Power BI, or equivalent.


• Experience with Agile (SAFe) methodologies, CI/CD pipelines, and modern deployment practices for data platforms.

Additional Desired Preferences

• Experience with scientific chemistry nomenclature or prior work experience in life sciences, chemistry, or hard sciences or degree in sciences


• Experience with pharmaceutical datasets and nomenclature


• Ability to explain complex technical issues to a non‑technical audience

Supervisory Responsibilities

No

Benefits

USP provides you with the benefits you need to protect yourself and your family today and tomorrow. From company‑paid time off, comprehensive healthcare options to retirement savings, you can have peace of mind that your personal and financial wellbeing is protected.

USP is proud to be an equal employment opportunity employer (EEOE) and affirmative action employer. We are committed to creating an inclusive environment in all aspects of our work—from the standards we make to the partnerships and conversations we cultivate. An environment where every employee feels fully empowered and valued irrespective of, but not limited to, personality, race, ethnicity, physical and mental abilities, education, religion, gender identity and expression, life experience, sexual orientation, country of origin, regional differences, work experience, and family status. We are committed to working with and providing reasonable accommodation to individuals with disabilities.

Note: USP does not accept unsolicited resumes from 3rd party recruitment agencies and is not responsible for fees from recruiters or other agencies except under specific written agreement with USP.

Job Category

Information Technology

Job Type

Full‑Time