Senior Data Engineer

Statistics & Data Corporation (SDC); Hyderabad; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Statistics & Data Corporation (SDC) in Hyderabad is seeking a Senior Data Engineer to design and automate data processes for clinical trials. The role includes developing robust data architecture and ensuring data governance across various data sources.

The ideal candidate will have a Bachelor’s degree and significant experience in data engineering. Strong skills in Python, SQL databases, and ETL processes are essential for success in this role.

Qualifications

• 7+ years of experience with the last ~4 years centric to data engineering.
• Ability to mentor other data engineers.
• Strong written and verbal communication skills.

Responsibilities

• Design and develop data architecture for applications and data sources.
• Establish data governance best practices.
• Design ETL frameworks for scalable data pipelines.
• Mentor other data engineers.
• Engage with departments to implement data pipelines.

Skills

Fluency in Python

Modern RDBMS concepts

Data warehouse design

Database systems understanding

System design capabilities

Software development lifecycle experience

Mentorship abilities

Stakeholder communication

Problem-solving skills

Leadership and time management

Education

Bachelor’s degree in a technical field with 7 years of technical experience

Job description

Senior Data Engineer

Statistics & Data Corporation (SDC) is a specialized contract research organization headquartered in Arizona. The Senior Data Engineer will design and automate cleaning, processing, and analyzing of both clinical and nonclinical data to support better understanding of the safety and efficacy of new clinical therapies, and contribute to AI‑driven solutions in clinical trials.

Responsibilities

• Design and develop data architecture for new and existing applications and data sources.
• Establish data quality, data governance, and master data management best practices.
• Design ETL frameworks and features for robust, scalable data pipelines.
• Incorporate new pipelines into the existing data model, augmenting as needed.
• Manage and maintain several production systems.
• Engage with cross‑functional departments to design, develop, and implement data pipelines.
• Improve team productivity through better tools and processes.
• Apply good documentation, coding, and testing best practices.
• Develop standard operating procedures for AI and data engineering in clinical trials.
• Prototype new ideas/technologies to create proof of concept and demos.
• Provide mentorship to other data engineers.
• Assist in executing Data Engineer responsibilities:
  • Maintain and develop ETL pipelines.
  • Maintain an enterprise data warehouse.
  • Follow data quality, governance, and MDM best practices.
  • Deliver high‑quality design documentation.
  • Prototype new ideas and contribute to SOP development.
  • Perform other related duties incidental to the work.
• Adhere to essential systems and processes required to maintain compliance with business and regulatory requirements.
• Act as a resource for teammates for debugging, code review, and other software development lifecycle activities.
• Have contract research organization experience and familiarity with its operations.

Required Skills

• Fluency in Python for parsing, manipulating, and converting data to and from a wide range of formats (CSV, JSON, XML, HTML, SQL tables).
• Deep understanding of modern RDBMS concepts (triggers, indexes, views, stored procedures) and SQL syntax, with experience with at least one modern RDBMS.
• Ability to design efficient data warehouses following dimensional modeling principles for scalable reporting.
• Solid understanding of multiple database systems (No‑SQL, SQL).
• System design capabilities to improve operational efficiency and costs.
• Experience in the software development lifecycle.
• Ability to mentor other data engineers and increase team productivity.
• Ability to work with stakeholders to translate business requirements into clear technical specifications.
• Strong written and verbal communication skills.
• Ability to identify issues, present problems, and implement solutions.
• Excellent leadership, organizational, and time‑management skills with the ability to multitask.
• Strong interpersonal communication and presentation skills.

Education or Equivalent Experience

Bachelor’s degree in a technical field with 7 years of technical experience, with the last ~4 years being data‑engineering centric, or 10+ years in a technical role with the last ~5 years being data‑engineering centric.