We are seeking a senior, hands-on Databricks Integration Lead to lead the integration architecture for a large-scale migration from Veeva CRM to Vault CRM. This role will oversee the assessment and optimization of 46 integration points across five Veeva CRM environments, establishing scalable integration solutions and guiding a distributed engineering team. The ideal candidate has deep, recent Databricks experience, strong integration architecture skills, and a background in life sciences or pharmaceutical environments.
Key Responsibilities
- Lead end-to-end integration architecture across Databricks, Veeva CRM, Vault CRM, and connected enterprise systems.
- Analyze and rationalize existing integrations, identifying opportunities to consolidate, optimize, or eliminate interfaces.
- Establish architecture standards using Spark, Delta Lake, Unity Catalog, and workflow orchestration.
- Define data mapping, integration patterns, and coexistence strategies during the CRM migration.
- Review technical designs, data pipelines, and engineering deliverables while providing hands-on technical guidance.
- Establish data validation, reconciliation, monitoring, and production support processes.
- Lead technical planning for migration cutover, rollback, and ongoing operations.
Required Qualifications
- 10+ years of experience in data integration or architecture, including 5+ years of hands-on Databricks experience in enterprise environments.
- Strong expertise in PySpark, Spark SQL, Delta Lake, Databricks Workflows, Delta Live Tables, Auto Loader, and Unity Catalog.
- Experience leading large-scale, multi-system integration initiatives.
- Hands-on experience with Veeva CRM data models and integrations; Vault CRM experience preferred.
- Background in life sciences or pharmaceutical commercial data, including HCP/HCO, samples, consent, and customer data.
- Strong knowledge of REST/SOAP APIs, data pipelines, and batch/event-based integrations.
- Proven ability to lead technical teams, including offshore and distributed resources.
- Familiarity with GxP validation, data governance, and regulated environments.
Preferred Qualifications
- Experience with Veeva CRM to Vault CRM migrations or other CRM platform migrations.
- Databricks certifications in Data Engineering or Solution Architecture.
- Experience with Veeva Network, OpenData, and integration rationalization.
- Knowledge of Terraform, Azure DevOps, GitHub Actions, and cloud platforms (Azure, AWS, or GCP).