Contract Type: W2 Duration: 5+ Months Location: San Jose, CA (#LI-Hyrid) Pay Range: $85-$90/hr.
Job Summary
Contract Platform Architect for Adobe Unified Platform (AUP) - Data Platform-as-a-Service (DPaaS), supporting a Databricks-based enterprise data platform during a temporary parental-leave backfill. The architect will provide technical leadership and architectural continuity, support the SQL Server-to-Databricks migration, enforce data platform governance, troubleshoot architecture issues, and partner with DevOps, DataOps, and platform teams. This is a fixed-term contractor role requiring someone who can quickly ramp up in an existing enterprise environment and document decisions for a smooth handoff.
Primary Skills
- Databricks (advanced)
- Unity Catalog (advanced)
- SQL Server migration (intermediate)
- PySpark/Scala (intermediate)
- Data Governance (advanced)
Key Responsibilities
- Serve as the primary architecture point of contact for the Databricks + Unity Catalog DPaaS platform during the coverage period.
- Support and unblock the SQL Server-to-Databricks/lakehouse migration, including alignment with the SAP HANA/RISE migration timeline.
- Review and advise on data schemas, pipelines, compute architecture, and platform design.
- Enforce Databricks governance standards covering: Duplicate-data prevention Environment segregation Compute selection Engineering standards Cost visibility Identify and prevent data architecture anti-patterns and unnecessary data duplication.
- Partner with DevOps, DataOps, and platform support teams to keep architecture-dependent initiatives moving.
- Provide recommendations on platform decisions such as BI tooling and compute tiers.
- Troubleshoot production-scale data platform, Spark, Delta Lake, SQL, and pipeline issues.
- Document architectural decisions, rationale, open issues, and recommendations for handoff to the returning architect.
Must-Have Skills
- Strong Data/Platform Architecture experience with Databricks at enterprise scale.
- Hands-on experience with Databricks and Unity Catalog governance.
- Strong experience with data platform migrations, preferably SQL Server to Databricks/lakehouse.
- Hands-on Spark experience using PySpark or Scala.
- Strong Delta Lake experience, including pipeline design, performance tuning, and troubleshooting.
- Advanced SQL, including query optimization and schema design across multi-schema/multi-workspace environments.
- Strong understanding of data governance, access controls, lineage, metadata management, auditability, and least-privilege design.
- Understanding of Databricks compute and cost management, including cluster sizing, job vs. all-purpose compute, and autoscaling.
- Experience with Azure or AWS cloud infrastructure supporting Databricks, including networking, storage, and access control.
- Experience with data pipeline orchestration/CI-CD tools such as Databricks Workflows/Jobs, Airflow, Azure DevOps, or similar.
- Experience integrating or migrating ERP-related systems such as SAP/HANA into a lakehouse environment.
- Strong written communication and documentation skills.
- Ability to quickly understand and take ownership of an in-flight enterprise data platform.