Databricks Platform Lead: Data & AI Solutions

Archer; États-Unis; Sur place; USD 140 000 - 210 000; Plein temps

Résumé du poste

Archer is seeking a Databricks Platform SME to join Version 1’s Data & AI Practice. You will own Databricks administration, governance, entitlements, performance optimisation, and operational management, guiding scalable, cloud-native data solutions enabling analytics and AI at scale.

This delivery-focused role requires solving complex data challenges, taking ownership of platform outcomes, and applying engineering discipline in real-world environments.

Qualifications

• 8+ years in hands-on data platform engineering.
• Strong Databricks expertise including platform administration, governance, and performance optimisation.
• Hands-on experience managing Databricks workspaces, clusters, jobs, notebooks, and production Spark workloads.
• At least 2 Databricks platform implementations from design to production in the last 4 years.
• Strong Python/Java and SQL capabilities.
• Proven experience building and operating batch and streaming pipelines in production.
• Hands-on experience with CI/CD, monitoring/observability tooling, and data quality.

Responsabilités

• Partner with stakeholders to build scalable data platforms.
• Take primary ownership of the Databricks platform, including admin, governance, and cost efficiency.
• Manage workspaces, access controls, configuration, and performance.
• Build cloud-native data solutions on AWS.
• Troubleshoot production systems and implement continuous improvements.
• Ensure solutions are production-ready: secure, tested, observable, and cost-efficient.
• Design, build, and operate batch and streaming pipelines.
• Develop high-throughput, low-latency data processing.
• Orchestrate data workflows using Airflow or similar tools.
• Write clean, well-tested code following best practices.

Connaissances

Databricks Admin

Governance

Access Management

Performance Optimisation

Data Pipelines

Python

SQL

Airflow

dbt

Spark

Outils

Databricks

dbt

Airflow

Postgres

SQL Server

Description du poste

Archer is seeking a Databricks Platform SME to join Version 1’s Data & AI Practice. You will own Databricks administration, governance, entitlements, performance optimisation, and operational management, guiding scalable, cloud-native data solutions enabling analytics and AI at scale.

This delivery-focused role requires solving complex data challenges, taking ownership of platform outcomes, and applying engineering discipline in real-world environments.