Senior Databricks Data Engineer - Platform & Pipelines

Object Edge; United States; Remoto; USD 110.000 - 170.000; Tempo integral

Resumo da vaga

Object Edge is an AI-native, forward-deployed engineering firm that builds Hive for revenue insights and delivers end-to-end design and development solutions for clients. The role focuses on leading data platform initiatives on the Databricks Platform, delivering scalable data pipelines and platform solutions with Delta Lake and Unity Catalog.

You will work with a solution architect to design client data platforms and participate in a Center of Excellence.

Qualificações

• Hands-on data pipeline design experience with Databricks.
• Experience building scalable YAML-driven data pipelines for batch and streaming.
• Proficient in SQL and Python; knowledge of OO languages.

Responsabilidades

• Develop and implement data solutions using Databricks Delta Lake and Delta Live Tables.
• Collaborate with cross-functional teams to design and optimize data pipelines for batch and streaming data.
• Stay updated with emerging technologies and improve Databricks skills.

Conhecimentos

Databricks data pipelines

Batch & streaming pipelines

SQL

Python

OO languages

Airflow

dbt

Ferramentas

Delta Lake

Unity Catalog

Airflow

dbt

Databricks

Descrição da vaga

Object Edge is an AI-native, forward-deployed engineering firm that builds Hive for revenue insights and delivers end-to-end design and development solutions for clients. The role focuses on leading data platform initiatives on the Databricks Platform, delivering scalable data pipelines and platform solutions with Delta Lake and Unity Catalog.

You will work with a solution architect to design client data platforms and participate in a Center of Excellence.