Databricks Platform Architect

Darwin Recruitment GmbH; Deutschland; Remote; EUR 60.000 - 80.000; Vollzeit

Zusammenfassung

An innovative firm is looking for a Freelance Platform Architect to spearhead the migration of enterprise data platforms from Oracle to Azure Databricks. This role demands profound expertise in data architecture and cloud migration strategies, ensuring the development of a scalable and high-performance cloud data platform. The successful candidate will lead the design of a modern data platform, implement efficient ETL/ELT pipelines, and optimize the Databricks environment for security and governance. If you're ready to take on a pivotal role in transforming data platforms, this opportunity is for you!

Qualifikationen

• Deep expertise in data architecture and cloud migration strategies required.
• Hands-on experience with Oracle to Databricks transitions is essential.

Aufgaben

• Lead migration strategy for large-scale Oracle databases to Databricks on Azure.
• Design a modern data platform optimizing data ingestion and analytics.

Kenntnisse

Data Architecture

Cloud Migration Strategies

Performance Optimization

ETL/ELT Pipelines

Data Integrity

Tools

Azure Databricks

Delta Lake

Spark

CI/CD

Infrastructure-as-Code (IaC)

Jobbeschreibung

Darwin is a Specialist Talent Delivery Partner for Databricks Projects. Over the past 6 Years we have supported some of the largest Databricks programs around the Globe.

We are seeking a Freelance Platform Architect to lead the migration of enterprise data platforms from Oracle to Azure Databricks.

This role requires deep expertise in data architecture, cloud migration strategies, and performance optimization. The ideal candidate will have hands-on experience in transitioning on-premises Oracle databases to Databricks on Azure, ensuring a scalable, high-performance, and cost-efficient cloud data platform.

Responsibilities:

1. Architect and lead the migration strategy for moving large-scale Oracle databases and workloads to Databricks on Azure.
2. Design a modern data platform that optimizes data ingestion, transformation, and analytics using Azure Databricks, Delta Lake, and Spark.
3. Develop and implement ETL/ELT pipelines to efficiently migrate and transform Oracle data into Databricks while ensuring data integrity.
4. Optimize performance, security, and governance of the Databricks environment to meet enterprise requirements.
5. Collaborate with database administrators, data engineers, and business stakeholders to ensure a smooth migration process with minimal disruption.
6. Define best practices for cost optimization, workload orchestration, and infrastructure scaling in Azure.
7. Implement CI/CD pipelines and infrastructure-as-code (IaC) for automated deployments and infrastructure management.
8. Monitor and troubleshoot data processing, storage, and networking issues during and after migration.
9. Provide technical leadership and hands-on guidance to engineering teams.

Duration: 12 Months (Open to an extension)

Location: Remote (Potential visits to DE & NL Locations)

Darwin Recruitment is acting as an Employment Business in relation to this vacancy.