Senior Data Engineer

Statistics & Data Corporation; Hyderabad; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Statistics & Data Corporation seeks a Senior Data Engineer in Hyderabad to design, automate, and analyze data for clinical trials. You will contribute to AI-driven solutions while enhancing data quality and governance practices.

The ideal candidate should have a Bachelor's degree and 7 years of technical experience. Key responsibilities include developing robust data pipelines and mentoring junior data engineers. Strong Python and RDBMS skills are essential.

Qualifications

• 7 years of technical experience, with 4 years focused on data engineering, or 10+ years in a technical role with 5 years data engineering experience.

Responsibilities

• Design and develop data architecture for applications.
• Establish data quality and governance practices.
• Create ETL frameworks for data pipelines.
• Mentor junior data engineers.

Skills

Fluency in Python

Deep understanding of RDBMS

Ability to design efficient data warehouses

System design capabilities

Experience in software development lifecycle

Mentoring skills

Strong communication skills

Problem identification and solution implementation

Leadership and organizational skills

Education

Bachelor’s degree in a technical field

Job description

Senior Data Engineer

Statistics & Data Corporation (SDC) is a specialized contract research organization headquartered in Arizona. The Senior Data Engineer will design and automate cleaning, processing, and analyzing of both clinical and nonclinical data to support better understanding of the safety and efficacy of new clinical therapies, and contribute to AI‑driven solutions in clinical trials.

Responsibilities

• Design and develop data architecture for new and existing applications and data sources.
• Establish data quality, data governance, and master data management best practices.
• Design ETL frameworks and features for robust, scalable data pipelines.
• Incorporate new pipelines into the existing data model, augmenting as needed.
• Manage and maintain several production systems.
• Engage with cross‑functional departments to design, develop, and implement data pipelines.
• Improve team productivity through better tools and processes.
• Apply good documentation, coding, and testing best practices.
• Develop standard operating procedures for AI and data engineering in clinical trials.
• Prototype new ideas/technologies to create proof of concept and demos.
• Provide mentorship to other data engineers.
• Assist in executing Data Engineer responsibilities:
  • Maintain and develop ETL pipelines.
  • Maintain an enterprise data warehouse.
  • Follow data quality, governance, and MDM best practices.
  • Deliver high‑quality design documentation.
  • Prototype new ideas and contribute to SOP development.
  • Perform other related duties incidental to the work.
• Adhere to essential systems and processes required to maintain compliance with business and regulatory requirements.
• Act as a resource for teammates for debugging, code review, and other software development lifecycle activities.
• Have contract research organization experience and familiarity with its operations.

Required Skills

• Fluency in Python for parsing, manipulating, and converting data to and from a wide range of formats (CSV, JSON, XML, HTML, SQL tables).
• Deep understanding of modern RDBMS concepts (triggers, indexes, views, stored procedures) and SQL syntax, with experience with at least one modern RDBMS.
• Ability to design efficient data warehouses following dimensional modeling principles for scalable reporting.
• Solid understanding of multiple database systems (No‑SQL, SQL).
• System design capabilities to improve operational efficiency and costs.
• Experience in the software development lifecycle.
• Ability to mentor other data engineers and increase team productivity.
• Ability to work with stakeholders to translate business requirements into clear technical specifications.
• Strong written and verbal communication skills.
• Ability to identify issues, present problems, and implement solutions.
• Excellent leadership, organizational, and time‑management skills with the ability to multitask.
• Strong interpersonal communication and presentation skills.

Education or Equivalent Experience

Bachelor’s degree in a technical field with 7 years of technical experience, with the last ~4 years being data‑engineering centric, or 10+ years in a technical role with the last ~5 years being data‑engineering centric.