Remote Senior Databricks Engineer for Pharma Data Pipelines

Bitcruit Solutions; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Bitcruit Solutions is seeking a Senior Databricks Data Engineer with deep pharma/scientific data experience to design and optimize Databricks pipelines for clinical, laboratory, and assay data.

The ideal candidate will work directly with scientists and business stakeholders to translate data requirements into scalable solutions, with strong emphasis on data modeling, integration and quality. This is a 6-month remote contract for US-based professionals, starting within 2–3 weeks.

Qualifications

• Hands-on Databricks engineering experience in pharma/scientific data environments.
• Strong Python, PySpark and SQL coding skills.
• Proven ability to build and maintain data ingestion and transformation pipelines.

Responsibilities

• Design, develop and optimize data pipelines, transformations, views and data solutions within Databricks.
• Engage with scientists and stakeholders to gather and document requirements.
• Model data for complex pharmaceutical datasets including laboratory, assay and clinical data.
• Establish relationships between compounds, assays, experimental results and identifiers.
• Integrate data from multiple scientific systems, lab sources and external vendors.
• Handle corrected or revised scientific data and maintain data quality through reprocessing pipelines.
• Translate requirements into scalable Databricks solutions and explain design decisions to stakeholders.
• Troubleshoot data quality, integration and modeling issues.

Skills

Databricks

Python

PySpark

SQL

Data pipelines

Data modeling

Data integration

Data quality

Job description

Bitcruit Solutions is seeking a Senior Databricks Data Engineer with deep pharma/scientific data experience to design and optimize Databricks pipelines for clinical, laboratory, and assay data.

The ideal candidate will work directly with scientists and business stakeholders to translate data requirements into scalable solutions, with strong emphasis on data modeling, integration and quality. This is a 6-month remote contract for US-based professionals, starting within 2–3 weeks.