Databricks Integration Lead

New York Technology Partners

Indianapolis (IN)

Sur place

USD 180 000 - 240 000

Plein temps

Il y a 32 heures
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

New York Technology Partners is seeking a senior, hands-on Databricks Integration Lead to drive a large-scale migration from Veeva CRM to Vault CRM across five environments and 46 integration points. You will architect data flows, lead onshore and offshore teams, and remain hands-on to ensure successful delivery.

Responsibilities include designing pipelines with PySpark, enforcing Delta Lake governance, and validating data mappings and migrations in a regulated life sciences context.

Qualifications

  • 10+ years of data integration/architecture experience.
  • 5+ years hands‑on Databricks in production environments.
  • Veeva CRM integration experience, Vault CRM knowledge preferred.
  • Experience with complex enterprise data integrations, ETL/ELT pipelines, APIs, and CRM migrations.
  • Background in life sciences environments, including commercial data and GxP requirements.

Responsabilités

  • Lead end-to-end integration architecture across Databricks, Veeva CRM, and Vault CRM.
  • Design, build, test, and deploy data pipelines and integrations using PySpark, Spark SQL, and APIs.
  • Analyze and optimize existing integrations, ensuring data mapping, migration, and reconciliation.
  • Establish standards for Delta Lake, Unity Catalog, CI/CD, data quality, and governance.
  • Provide technical leadership to onshore and offshore engineering teams while remaining hands‑on.

Connaissances

Leadership
Architectural design
Hands-on

Outils

Databricks
PySpark
Spark SQL
Delta Lake
Unity Catalog
Databricks Workflows
Veeva Vault CRM

Description du poste

We’re seeking a senior, hands‑on Databricks Integration Lead to support a large‑scale migration from Veeva CRM to Vault CRM. This project involves five Veeva CRM environments and 46 integration points that need to be analyzed, optimized, and migrated. The ideal candidate will lead integration architecture, guide engineering teams, and actively develop and deploy solutions. Deep, recent, hands‑on Databricks experience is the top priority, along with Veeva CRM integration expertise.

Key Responsibilities
  • Lead end-to-end integration architecture across Databricks, Veeva CRM, and Vault CRM.
  • Design, build, test, and deploy data pipelines and integrations using PySpark, Spark SQL, and APIs.
  • Analyze and optimize existing integrations, ensuring accurate data mapping, migration, and reconciliation.
  • Establish standards for Delta Lake, Unity Catalog, CI/CD, data quality, and governance.
  • Provide technical leadership to onshore and offshore engineering teams while remaining hands‑on.
Required Qualifications
  • 10+ years of data integration/architecture experience, including 5+ years of hands‑on Databricks in production environments.
  • Strong expertise in PySpark, Spark SQL, Delta Lake, Unity Catalog, and Databricks workflows.
  • Veeva CRM integration experience, with Vault CRM knowledge strongly preferred.
  • Experience with complex enterprise data integrations, ETL/ELT pipelines, APIs, and CRM migrations.
  • Background in pharmaceutical or life sciences environments, including commercial data and GxP requirements.
  • Proven ability to lead technical teams while actively developing and deploying solutions.
Preferred Qualifications
  • Previous Veeva CRM to Vault CRM migration experience.
  • Databricks certifications and experience with cloud platforms (AWS, Azure, or GCP).
  • Familiarity with Informatica/IICS, Terraform, and DevOps/CI/CD tools.
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Databricks Integration Lead (Veeva CRM)
Databricks Integration Lead (Veeva CRM)

New York Technology Partners • Indianapolis (IN)

Sur place
USD 180 000 - 230 000
Databricks Integration Lead
Databricks Integration Lead

New York Technology Partners • États-Unis

Sur place
USD 170 000 - 210 000
Databricks Integration Lead: CRM Migration Architect
Databricks Integration Lead: CRM Migration Architect

New York Technology Partners • Indianapolis (IN)

Sur place
USD 180 000 - 230 000
Senior Databricks Integration Architect: Veeva to Vault Migration
Senior Databricks Integration Architect: Veeva to Vault Migration

New York Technology Partners • Indianapolis (IN)

Sur place
USD 180 000 - 240 000
Databricks Integration Architect: End-to-End Migration
Databricks Integration Architect: End-to-End Migration

New York Technology Partners • États-Unis

Sur place
USD 170 000 - 210 000
Databricks Architect
Databricks Architect

Quantum Integrators • Raritan (NJ)

Sur place
USD 150 000 - 220 000
Veeva Vault Consultant
Veeva Vault Consultant

RADcube • Indianapolis (IN)

Sur place
USD 110 000 - 160 000
Databricks Data Architect/Lead
Databricks Data Architect/Lead

Celebal Technologies • États-Unis

Sur place
USD 180 000 - 240 000
Veeva Vault Data Migration Specialist
Veeva Vault Data Migration Specialist

TechClub Inc • Summit (NJ)

Sur place
USD 110 000 - 130 000
Databricks Data Engineer Architect
Databricks Data Engineer Architect

Apolis • El Segundo (CA)

Sur place
USD 180 000 - 240 000