Senior Data Engineer (Databricks) (Fully Remote)

Object Edge; United States; Remote; USD 110,000 - 170,000; Full time

Job summary

Object Edge is an AI-native, forward-deployed engineering firm that builds Hive for revenue insights and delivers end-to-end design and development solutions for clients. The role focuses on leading data platform initiatives on the Databricks Platform, delivering scalable data pipelines and platform solutions with Delta Lake and Unity Catalog.

You will work with a solution architect to design client data platforms and participate in a Center of Excellence.

Qualifications

• Hands-on data pipeline design experience with Databricks.
• Experience building scalable YAML-driven data pipelines for batch and streaming.
• Proficient in SQL and Python; knowledge of OO languages.

Responsibilities

• Develop and implement data solutions using Databricks Delta Lake and Delta Live Tables.
• Collaborate with cross-functional teams to design and optimize data pipelines for batch and streaming data.
• Stay updated with emerging technologies and improve Databricks skills.

Skills

Databricks data pipelines

Batch & streaming pipelines

SQL

Python

OO languages

Airflow

dbt

Tools

Delta Lake

Unity Catalog

Airflow

dbt

Databricks

Job description

• Be a technical leader in teams with minimal oversight to deliver innovative solutions on the Databricks Platform.
• Build next-generation data platforms and contribute to the Databricks Center of Excellence.
• Work under a Solution Architect to design and implement client data platform solutions.

What You’ll Bring:

• At least 2 years of hands-on data pipeline design with Databricks, including Delta Lake and Unity Catalog.
• Proficiency in building scalable, YAML configuration-driven data pipelines with batch and streaming patterns.
• Strong programming skills in SQL, Python, and object-oriented languages, plus exposure to Airflow and dbt.

Key Responsibilities:

• Develop and implement data solutions using Databricks features such as Delta Lake and Delta Live Tables.
• Collaborate with cross-functional teams to design and optimize data pipelines for batch and streaming data.
• Stay updated with emerging technologies and continuously improve Databricks skills.

Object Edge

Object Edge is an AI-native, forward-deployed engineering firm that builds Hive, a company brain for revenue, and delivers end-to-end design and development solutions for clients. Its global teams unite curious, intellectual advisors who creatively solve business problems and produce measurable results.