Senior Databricks AI Engineer: GenAI & Agentic ML

Black Rock Groups; Town of Florida (NY); On-site; USD 110,000 - 115,000; Full time

Benefits offered by this job

medical insurance

vision insurance

dental insurance

life insurance

disability insurance

paid time off

Job summary

Tech Mahindra is seeking a Data Bricks AI Engineer to design and build intelligent, scalable AI solutions in a day-one onsite role in Juno Beach, FL. The candidate will implement AI agents, RAG architectures, and enterprise-grade data platforms using Databricks.

Key responsibilities include developing scalable data pipelines with PySpark and SQL, leveraging LLMs, and integrating agentic AI across enterprise systems, with emphasis on governance and MLOps practices.

Qualifications

• 8+ years of experience in data engineering or AI engineering roles.
• Hands-on Databricks and PySpark development experience required.
• Strong capability in Python and SQL for building scalable data pipelines.
• Expertise in Generative AI, LLMs, prompt engineering, and retrieval-augmented generation (RAG).
• Proficiency building AI agents and multi-agent systems using modern frameworks.
• Experience with vector databases and embedding storage (Pinecone, ChromaDB, FAISS, Weaviate).
• Cloud platform experience (Azure, AWS, or GCP) is a must.

Responsibilities

• Develop scalable data pipelines and AI solutions using Databricks, PySpark, Python, and SQL.
• Design Generative AI applications leveraging LLMs like GPT, Claude, and Llama.
• Build Agentic AI solutions with LangChain, LangGraph, CrewAI, AutoGen, or Semantic Kernel.
• Develop and optimize RAG architectures using vector databases and embeddings.
• Utilize Databricks Mosaic AI, MLflow, Unity Catalog, and Vector Search for governance.
• Integrate AI agents with enterprise systems, APIs, databases and knowledge bases.
• Implement MLOps practices for deployment, monitoring, and continuous improvement.

Skills

Databricks

PySpark

Python

SQL

Generative AI

LLMs

Prompt Engineering

RAG

AI Agents

Multi-Agent Systems

LangChain

LangGraph

CrewAI

AutoGen

Vector Databases

Pinecone

ChromaDB

FAISS

Weaviate

Azure

AWS

GCP

Tools

LangChain

LangGraph

CrewAI

AutoGen

Semantic Kernel

Pinecone

ChromaDB

FAISS

Weaviate

MLflow

Unity Catalog

Job description

Tech Mahindra is seeking a Data Bricks AI Engineer to design and build intelligent, scalable AI solutions in a day-one onsite role in Juno Beach, FL. The candidate will implement AI agents, RAG architectures, and enterprise-grade data platforms using Databricks.

Key responsibilities include developing scalable data pipelines with PySpark and SQL, leveraging LLMs, and integrating agentic AI across enterprise systems, with emphasis on governance and MLOps practices.