Senior Data Engineer

SDC (Statistics & Data Corporation); Hyderabad; On-site; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Competitive pay

Generous time off

Positive work/life balance

Flexible work schedule

Job summary

SDC (Statistics & Data Corporation) is seeking a Senior Data Engineer to design and automate data processing to support clinical trials. This role involves data architecture development, ETL frameworks, and fostering collaboration with internal teams.

As a key position, the engineer will utilize their knowledge of Python and SQL to enhance data quality and governance while mentoring others. SDC offers competitive pay and a flexible work schedule.

Qualifications

• 7+ years of technical experience with recent years in a Data Engineering-focused role.
• Capability to communicate technical concepts clearly to non-technical colleagues.

Responsibilities

• Designs data architecture for applications and data sources.
• Establishes Data Quality and Data Governance best practices.
• Implements and maintains scalable data pipelines.

Skills

Fluency in Python

RDBMS concepts

Data warehouse design

SQL syntax

No-SQL and SQL understanding

Operational efficiency design

Software development lifecycle

Mentoring skills

Stakeholder communication

Problem-solving abilities

Education

Bachelor's degree in a technical field

Job description

Statistics & Data Corporation (SDC), a specialized contract research organization (CRO) headquartered in Arizona, delivering top‑tier clinical trial services to pharmaceutical, biologic, and medical device/diagnostic companies since 2005. SDC provides a technology‑enabled service offering to give clients both clinical services expertise and the technology they need to be successful in their clinical trials.

Job Summary

The Senior Data Engineer will design and automate the cleaning, processing, and analyzing of both clinical data and nonclinical data with the goal of transforming data into information that supports better understanding of the safety and efficacy of new clinical therapies. The role contributes to the organization’s strong drive to be at the forefront of using Artificial Intelligence (AI) in clinical trials to simplify data processing and discover imperceptible correlations.

Primary Responsibilities

• Designs and develops data architecture for new and existing applications and data sources
• Establishes Data Quality, Data Governance and Master Data Management best practices to enable the business to maintain clean and accurate data
• Designs ETL frameworks and features to allow for robust and scalable data pipelines
• Incorporates new pipelines into the existing data model, augmenting as needed
• Manages and maintains several production systems
• Engages with various internal cross‑functional departments to strategically design, develop and implement data pipelines while understanding the underlying data
• Increases team productivity by developing, identifying, and implementing better tools and processes
• Exemplifies good documentation, coding, and testing best practices
• Develops standard operating procedures for the use of artificial intelligence and data engineering principles within clinical trials
• Prototypes new ideas/technologies to create proof of concept and demos
• Provides mentorship for other data engineers
• Maintains and develops ETL pipelines
• Maintains an Enterprise Data Warehouse by updating and translation logic and supporting warehouse servers
• Follows Data Quality, Data Governance and Master Data Management best practices
• Delivers high‑quality software design documentation
• Contributes to the development of standard operating procedures
• Performs other related duties incidental to the work described herein
• Adheres to all essential systems and processes required at SDC to maintain compliance with business and regulatory requirements
• Acts as a resource for other team members for debugging, code reviews and other software development lifecycle activities
• Contract Research Organization experience and familiarity with its operations

The above statements describe the general nature and level of work being performed by individuals assigned to this classification. This document is not intended to be an exhaustive list of all responsibilities and duties required of personnel so classified.

Requirements

Required Skills

• Fluency in Python with experience parsing, manipulating, and converting data to and from a wide range of formats (CSV, JSON, XML, HTML, SQL tables, etc.)
• Deep understanding of modern RDBMS concepts (triggers, indexes, views, stored procedures) and SQL syntax, including experience with at least one modern RDBMS
• Ability to design efficient data warehouse following dimensional modeling principles for scalable reporting
• Solid understanding of multiple database systems (No‑SQL and SQL)
• System design capabilities to improve operational efficiency and costs
• Experience in the software development lifecycle
• Ability to mentor other data engineers and increase team productivity
• Ability to work with stakeholders to translate business requirements into clear technical specifications
• Ability to communicate effectively in writing and verbally
• Ability to identify issues, present problems, and implement solutions
• Capability of communicating technical concepts clearly, concisely, and understandably to non‑technical colleagues
• Good leadership, organizational and time‑management skills, with the ability to multi‑task
• Strong interpersonal communication and presentation skills

Education Or Equivalent Experience

• Bachelor’s degree in a technical field with 7 years of technical experience with the last ~4 years being a Data Engineering‑centric role OR 10+ years in a technical role with the last ~5 years being a Data Engineering‑centric role

Benefits

• Competitive pay
• Generous time off
• Attainable career advances
• Positive work/life balance
• Flexible work schedule
• Engaging work culture and employee benefits