AI Engineer with Databricks

Univedge Consulting LLC; New York (NY); On-site; USD 130,000 - 190,000; Full time

Job summary

Univedge Consulting LLC is seeking a hands-on Databricks Specialist to design, develop, and productionize enterprise-grade GenAI solutions on the Databricks platform. You will build end-to-end pipelines for ingestion, embedding, retrieval and orchestration, work with Mosaic AI, MLflow and Unity Catalog, and collaborate directly with clients to translate business problems into scalable AI applications.

This role requires strong Python, PySpark, SQL and cloud experience (AWS or Azure) and a

Qualifications

• Hands-on experience with Databricks and big data pipelines.
• Strong client-facing communication and problem-solving skills.
• Experience deploying GenAI solutions in production.

Responsibilities

• Build end-to-end RAG, agentic AI and ML solutions on Databricks.
• Develop ingestion, embedding, retrieval, evaluation and orchestration pipelines.
• Collaborate with clients to translate business problems into scalable AI solutions.
• Implement CI/CD, automated testing, observability, security and production controls.

Skills

Databricks

Python

PySpark

SQL

RAG

LLMs

Vector databases

MLflow

APIs

AWS

Azure

Tools

Mosaic AI

MLflow

Vector Search

Model Serving

Unity Catalog

Job description

We are looking for a hands-on Databricks Specialist to design, develop and productionize enterprise-grade GenAI and agentic AI solutions using the Databricks platform.

Key Responsibilities

• Build end-to-end RAG, agentic AI and machine-learning solutions on Databricks
• Develop ingestion, chunking, embedding, retrieval, evaluation and orchestration pipelines
• Work hands-on with Mosaic AI, MLflow, Vector Search, Model Serving and Unity Catalog
• Integrate AI solutions with enterprise applications, APIs and data platforms
• Implement CI/CD, automated testing, observability, security and production controls
• Collaborate directly with clients to translate business problems into scalable AI solutions

Required Skills

• Strong hands-on experience with Databricks, Python, PySpark, SQL, RAG, LLMs, vector databases, MLflow, APIs and AWS or Azure. Excellent communication, problem-solving and client-facing skills are essential.