Senior Databricks Architect for Life Sciences Data Platform

Quantum Integrators; Raritan (NJ); Presencial; USD 150.000 - 220.000; Jornada completa

Descripción de la vacante

Quantum Integrators is seeking an experienced Databricks Architect to design scalable data platforms using the Databricks Lakehouse architecture. The role focuses on enterprise data engineering within Life Sciences, collaborating with business and technical stakeholders to deliver secure, compliant data solutions.

The candidate will lead architecture reviews, mentor engineers, and optimize workloads for cost, performance, and reliability across Azure, AWS, or Google Cloud environments.

Formación

• 10+ years in data engineering and data architecture.
• 3-5+ years hands-on experience with Databricks.
• Experience in Life Sciences industry (pharma/biotech/medical devices/healthcare).
• Strong knowledge of Apache Spark (PySpark/Scala/Spark SQL).
• Proficient in SQL and Python.
• Experience with Delta Lake, Unity Catalog, and Databricks Workflows.
• Experience with Azure/AWS/GCP cloud platforms.

Responsabilidades

• Design and implement enterprise-scale data platforms using Databricks.
• Architect end-to-end data solutions: ingestion, transformation, storage, analytics.
• Develop scalable ETL/ELT pipelines with Spark and Databricks.
• Design/optimize Delta Lake architectures for performance and reliability.
• Collaborate with stakeholders to translate data requirements into tech solutions.
• Define data governance, security, and best practices for Databricks.
• Lead architecture reviews, technical design sessions, and code reviews.
• Mentor data engineers and establish development standards.
• Integrate Databricks with enterprise data sources, APIs, and reporting tools.
• Support production deployments, troubleshooting, and performance tuning.
• Ensure data solutions align with Life Sciences regulatory requirements.

Conocimientos

Leadership

Stakeholder management

Communication

Data modeling

Problem solving

Analytical thinking

Mentoring

Architecture design

Presentation

Educación

Bachelor’s or Master’s in CS/Engineering or related field

Herramientas

Databricks

PySpark

Python

SQL

Unity Catalog

Databricks Workflows

Git

CI/CD

Descripción del empleo

Quantum Integrators is seeking an experienced Databricks Architect to design scalable data platforms using the Databricks Lakehouse architecture. The role focuses on enterprise data engineering within Life Sciences, collaborating with business and technical stakeholders to deliver secure, compliant data solutions.

The candidate will lead architecture reviews, mentor engineers, and optimize workloads for cost, performance, and reliability across Azure, AWS, or Google Cloud environments.