Senior Agentic AI Engineer: Enterprise Databricks Platform Lead

IDR, Inc.; Englewood (CO); On-site; USD 86,000 - 123,000; Full time

Benefits offered by this job

Medical coverage

Vision insurance

Dental insurance

Competitive compensation

Job summary

IDR, Inc. is seeking a Sr. Agentic AI Engineer to join our Colorado team. You will lead onboarding onto the enterprise Databricks platform on AWS, manage external data integration, and drive platform governance for an enterprise-scale AI/data engineering environment.

The role requires deep Databricks expertise, strong Python/SQL/PySpark skills, and experience mentoring engineers to deliver scalable data pipelines in a regulated industry setting.

Qualifications

• Bachelor’s degree in CS, IS, Data Engineering or equivalent experience.
• 5+ years in data/platform engineering or cloud data roles.
• Experience administering Databricks at scale including Unity Catalog and Delta Lake.
• CI/CD for Databricks using Terraform, Asset Bundles, or GitLab.
• Proficiency in Python, SQL, and PySpark for production data pipelines.

Responsibilities

• Lead the onboarding of users and data domains onto the enterprise Databricks platform on AWS.
• Solve complex problems related to external data source integration, governance, deployment of Databricks-native AI capabilities, and cost attribution.
• Set technical patterns, mentor junior engineers, and own integration work for enterprise scale.

Skills

Data engineering

Platform engineering

Mentoring

Education

Bachelor’s degree or equivalent experience

Tools

Databricks

Unity Catalog

Delta Lake

Terraform

GitLab

Asset Bundles

CI/CD tooling

PySpark

Python

SQL

Job description

IDR, Inc. is seeking a Sr. Agentic AI Engineer to join our Colorado team. You will lead onboarding onto the enterprise Databricks platform on AWS, manage external data integration, and drive platform governance for an enterprise-scale AI/data engineering environment.

The role requires deep Databricks expertise, strong Python/SQL/PySpark skills, and experience mentoring engineers to deliver scalable data pipelines in a regulated industry setting.