Remote Databricks Data Engineer - Lakehouse Architect

OpenTalent; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

OpenTalent is seeking a Databricks Data Engineer for a 100% remote role in the United States. You will shape the Lakehouse architecture, applying Delta Lake, Photon, and Unity Catalog, and establish global code refactoring standards and PySpark best practices to ensure scalable data pipelines.

You will lead migrations, oversee integration of migration accelerators, optimize PySpark workflows, resolve complex dependency mappings, and design zero-downtime deployment strategies to keep production

Responsibilities

• Architectural Strategy & Governance: Design the target Databricks Lakehouse architecture utilizing Delta Lake, Photon, and Unity Catalog.
• Resolve highly complex dependency mappings and architect seamless, zero-downtime dual-run strategies.
• Lead the technical deployment and integration of specialized migration accelerators.

Job description

OpenTalent is seeking a Databricks Data Engineer for a 100% remote role in the United States. You will shape the Lakehouse architecture, applying Delta Lake, Photon, and Unity Catalog, and establish global code refactoring standards and PySpark best practices to ensure scalable data pipelines.

You will lead migrations, oversee integration of migration accelerators, optimize PySpark workflows, resolve complex dependency mappings, and design zero-downtime deployment strategies to keep production