Senior Databricks AI/ML Engineer: Scale Production ML

PEMCO; United States; On-site; USD 125,279 - 208,798; Full time

Benefits offered by this job

Medical, dental, and vision plans

401(k) plan with employer match

Vacation and personal days

Job summary

A leading mutual insurance company in the United States seeks an experienced Senior Databricks AI/ML Engineer to build scalable AI/ML solutions across various key functions such as underwriting and fraud detection. This role emphasizes Databricks architecture and includes responsibilities like designing data pipelines, deploying enterprise-grade ML systems, and collaborating with cross-disciplinary teams to improve decision-making processes. The ideal candidate has significant experience with Azure services and Databricks tools, and a strong background in ETL and data analytics.

Qualifications

• 6+ years of experience building ETL pipelines and managing production data workflows.
• 3+ years of experience with Azure and Databricks AI/ML products.
• Expertise in building and maintaining batch and streaming data pipelines.

Responsibilities

• Design and deploy Databricks workspaces across environments.
• Lead implementation of Databricks SQL and MLflow tracking.
• Develop automated MLOps workflows for model deployment.

Skills

ETL pipelines

Azure services

Databricks AI/ML

SQL

Machine Learning Algorithms

Distributed systems

Data streaming frameworks

Analytical skills

Collaboration

Education

B.A./B.S. degree in Computer Science or related

Master's degree preferred

Tools

Databricks

Azure Machine Learning

SQL Server

Apache Kafka

Power BI

Job description

A leading mutual insurance company in the United States seeks an experienced Senior Databricks AI/ML Engineer to build scalable AI/ML solutions across various key functions such as underwriting and fraud detection. This role emphasizes Databricks architecture and includes responsibilities like designing data pipelines, deploying enterprise-grade ML systems, and collaborating with cross-disciplinary teams to improve decision-making processes. The ideal candidate has significant experience with Azure services and Databricks tools, and a strong background in ETL and data analytics.