Senior Data Engineer - Pharma

TheMathCompany Inc.

India

On-site

INR 4,000,000 - 5,200,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

TheMathCompany Inc. is seeking a Senior Data Engineer to design and maintain scalable cloud-based data platforms and pipelines. The role emphasizes AWS, Snowflake, Databricks, Python, SQL, and PySpark to support analytics, reporting, and AI/ML initiatives.

You will collaborate with cross-functional teams to build reliable, secure, and high-performance data solutions and contribute to architecture reviews and best practices. Mentoring junior engineers is expected.

Qualifications

  • 5-8 years of experience in Data Engineering, Big Data, and Cloud Data Platform development.
  • Proficiency in Python, SQL, and PySpark.
  • Hands-on experience with AWS cloud data platforms (S3, Glue, EMR, Redshift).
  • Strong Snowflake and Databricks expertise for enterprise-scale data engineering.
  • Experience building batch and real-time streaming pipelines.
  • Knowledge of Data Modeling: Star/Snowflake/Data Vault.
  • Experience ETL/ELT design for large-scale platforms.
  • Proficiency in Apache Spark and distributed processing.
  • Experience with Data Lakes/Warehouses/Lakehouse architectures.
  • Familiarity with Git and CI/CD workflows.
  • Strong problem solving and collaboration in cross-functional teams.
  • Exposure to Agile/Scrum delivery environments.
  • Nice to have: Healthcare/Pharma/RWE data domains; IaC (Terraform/CloudFormation); Docker/Kubernetes; Data Mesh, CDC, and Event-Driven architectures; MLOps and AI/ML platform integration.

Responsibilities

  • Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks.
  • Build and optimize batch and real-time streaming solutions using PySpark and cloud-native services.
  • Develop and manage enterprise data platforms using AWS, Snowflake, and Databricks.
  • Design data models, data lakes, data warehouses, and lakehouse architectures.
  • Integrate data from multiple sources with emphasis on quality, governance, and security.
  • Optimize performance and scalability of data processing workloads.
  • Collaborate with Data Scientists, Analysts, Architects, and stakeholders.
  • Implement monitoring, alerting, and automated data validation processes.
  • Contribute to architecture reviews, technical docs, and best practices.
  • Mentor junior engineers and participate in code reviews.
  • Stay updated on emerging cloud and data engineering technologies.

Skills

Python
SQL
PySpark
AWS
Snowflake
Databricks
Airflow
ETL/ELT
Streaming
Data Modeling
Spark
CI/CD
Terraform
Docker
Kubernetes
Agile/Scrum
MLOps

Tools

Git
Terraform
CloudFormation
Docker
Kubernetes
Airflow

Job description

The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable cloud-based data platforms and data pipelines. The role requires strong expertise in AWS, Snowflake, Databricks, Python, SQL, and PySpark, along with experience in batch and real-time data processing. The candidate will collaborate with cross-functional teams to build reliable, secure, and highperformance data solutions that support analytics, reporting, and AI/ML initiatives.

Key Responsibilities:
  • Design, develop, and maintain scalable data pipelines and ETL/ELT frameworks.
  • Build and optimize batch and real-time streaming solutions using PySpark and cloud-native services.
  • Develop and manage enterprise data platforms using AWS, Snowflake, and Databricks.
  • Design and implement robust data models, data lakes, data warehouses, and lakehouse architectures.
  • Integrate data from multiple sources while ensuring data quality, governance, and security.
  • Optimize performance and scalability of data processing workloads.
  • Collaborate with Data Scientists, Analysts, Architects, and business stakeholders to deliver data solutions.
  • Implement monitoring, alerting, and automated data validation processes.
  • Contribute to architecture reviews, technical documentation, and best practices.
  • Mentor junior engineers and participate in code reviews.
  • Stay updated on emerging cloud and data engineering technologies.
Required Skills and Experience:
  • 5-8 years of relevant experience in Data Engineering, Big Data, and Cloud Data Platform development.
  • Strong proficiency in Python, SQL, and PySpark.
  • Hands‑on experience designing, developing, and maintaining scalable data platforms on AWS Cloud.
  • Strong expertise in Snowflake and Databricks for enterprise‑scale data engineering solutions.
  • Experience building and optimizing batch and real‑time streaming data pipelines.
  • Strong understanding of Data Modeling concepts, including Dimensional Modeling, Star Schema, Snowflake Schema, and Data Vault.
  • Experience designing and implementing ETL/ELT pipelines for large‑scale enterprise data platforms.
  • Strong expertise in Apache Spark and distributed data processing frameworks.
  • Experience building and managing Data Lakes, Data Warehouses, and Lakehouse architectures.
  • Hands‑on experience with AWS services such as S3, Glue, EMR, Lambda, Redshift, Athena, EC2, ECS/EKS, Kinesis, MSK, Step Functions, CloudWatch, IAM, RDS, DynamoDB, EventBridge, SNS, and SQS.
  • Experience integrating data from multiple structured and unstructured data sources.
  • Strong understanding of data governance, security, data quality, and performance optimization best practices.
  • Experience with version control systems such as Git and collaborative development workflows.
  • Proficiency with CI/CD pipelines and software engineering best practices.
  • Strong problem‑solving skills with the ability to debug, troubleshoot, and resolve complex data engineering challenges.
  • Ability to design scalable and maintainable data solutions using modern architectural patterns and best practices.
  • Proven ability to work collaboratively in cross‑functional teams, including participation in code reviews, technical discussions, and knowledge‑sharing initiatives.
  • Experience working in Agile/Scrum delivery environments.
  • Strong communication skills and ability to interact with business and technical stakeholders.
  • Experience in Healthcare, Pharma, or Real‑World Evidence (RWE) data environments (good to have).
  • Experience with Infrastructure as Code (Terraform/CloudFormation) (good to have).
  • Experience with Docker and Kubernetes (good to have).
  • Knowledge of Data Mesh, CDC, and Event‑Driven Architectures (good to have).
  • Exposure to MLOps and AI/ML platform integration (good to have).
  • AWS, Snowflake, or Databricks certifications (good to have).
Being a Mathemagician:
  • Embody MathCo’s culture and way of working.
  • Demonstrate ownership and strive for excellence in delivering results.
  • Actively engage and contribute to initiatives fostering company growth.
  • Support diversity and appreciate different perspectives.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Architect - Pharma
Data Architect - Pharma

TheMathCompany Inc. • India

On-site
INR 2,000,000 - 5,000,000
Data Science Manager - Pharma
Data Science Manager - Pharma

TheMathCompany Inc. • India

On-site
INR 1,400,000 - 2,600,000
Principal Data Architect
Principal Data Architect

Mathco • Bengaluru

On-site
INR 7,000,000 - 12,000,000
Data Engineer
Data Engineer

Mindpool Technologies • Bengaluru

Hybrid
INR 2,600,000 - 3,800,000
Senior Data Engineer
Senior Data Engineer

AagatiServe Pvt Ltd • Delhi

On-site
INR 1,800,000 - 2,400,000
Sr Data Scientist Bengaluru November 13, 2026 Know more
Sr Data Scientist Bengaluru November 13, 2026 Know more

Nexocean • Bengaluru

Remote
INR 2,600,000 - 4,800,000
Senior Data Engineer
Senior Data Engineer

Unison Group • Hyderabad

On-site
INR 800,000 - 1,500,000
Senior Data Engineer
Senior Data Engineer

Amgen Technology • Hyderabad

Hybrid
INR 2,500,000 - 4,000,000
Data Engineer
Data Engineer

Model Business Services • SECTOR 78

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer
Senior Data Engineer

Luxoft India • India

On-site
INR 1,500,000 - 2,000,000