Databricks Engineer: Medallion Architecture & Genie Spaces

aKube; United States; Remote; USD 112,963 - 122,606; Full time

Job summary

aKube is seeking a skilled Databricks Engineer in the United States. Your role includes building and supporting Databricks pipelines for new data ingestion, designing Bronze, Silver, and Gold data layers, and optimizing platform performance.

The ideal candidate will possess strong experience in building Medallion Architecture and debugging Genie Spaces. Advanced knowledge in SQL and Spark/PySpark is essential. This is a contract position for a duration of 1 month, offering competitive rates.

Qualifications

• Strong hands-on Databricks and Delta Lake engineering background.
• Proven experience building Medallion Architecture in production.
• Experience integrating multiple data sources into centralized data platforms.
• Direct experience with Databricks Genie Spaces is required.
• Strong SQL, Spark, and data performance tuning experience.

Responsibilities

• Build and support Databricks pipelines for new data source ingestion.
• Design and develop Bronze, Silver, and Gold data layers.
• Optimize Delta Lake tables, queries, and platform performance.
• Debug Genie Spaces and improve natural language query response quality.
• Tune underlying SQL and data models used by Genie Spaces.
• Support short-term delivery needs across the Databricks platform.

Skills

Advanced Databricks engineering experience

Data ingestion from new and diverse sources

Medallion Architecture: Bronze, Silver, Gold

Genie Space debugging, query tuning, and performance optimization

Advanced SQL and Spark/PySpark

Job description

aKube is seeking a skilled Databricks Engineer in the United States. Your role includes building and supporting Databricks pipelines for new data ingestion, designing Bronze, Silver, and Gold data layers, and optimizing platform performance.

The ideal candidate will possess strong experience in building Medallion Architecture and debugging Genie Spaces. Advanced knowledge in SQL and Spark/PySpark is essential. This is a contract position for a duration of 1 month, offering competitive rates.