Remote Databricks Engineer - AI Analytics & Lakehouse

IDR, Inc.; United States; Remote; CAD 168,000 - 251,000; Full time

Job summary

IDR, Inc. is seeking a Data Engineer (Databricks) to join a top client in a remote, direct-hire role.

Focused on developing and optimizing an enterprise lakehouse on Azure Databricks, the candidate will own multiple Databricks domains and leverage Databricks Genie for conversational analytics. The ideal candidate has 4+ years of Databricks experience, including data ingestion, security, governance, and data quality, and can independently own Databricks solutions while guiding best practices

Qualifications

• 4+ years hands-on Azure Databricks experience.
• Experience across multiple Databricks areas beyond pipelines.
• Hands-on with Databricks Genie for conversational analytics.
• Experience preparing data for AI initiatives.

Responsibilities

• Develop, maintain, and optimize an enterprise lakehouse on Azure Databricks.
• Own ingestion, pipelines, transformations, security, governance, and data quality.
• Leverage Databricks Genie to enable natural-language data exploration and AI-driven analytics.
• Collaborate with a small team to establish Databricks best practices.

Skills

Python

T-SQL

ANSI SQL

Agile methodologies

DevOps concepts

Git

AI-driven analytics

Tools

Azure Databricks

Databricks Genie

Job description

IDR, Inc. is seeking a Data Engineer (Databricks) to join a top client in a remote, direct-hire role.

Focused on developing and optimizing an enterprise lakehouse on Azure Databricks, the candidate will own multiple Databricks domains and leverage Databricks Genie for conversational analytics. The ideal candidate has 4+ years of Databricks experience, including data ingestion, security, governance, and data quality, and can independently own Databricks solutions while guiding best practices