Senior Data & AI Engineer (LLM/GenAI) on Azure

SANS Consulting Services, Inc.; United States; On-site; USD 150,000 - 230,000; Full time

Job summary

SANS Consulting Services, Inc. seeks a Senior Data & AI / LLM Engineer to design, build, and operationalize data, ML, and Generative AI solutions in the insurance domain.

This is a hands-on engineering role spanning the full lifecycle from problem understanding to production deployment on Azure. The role emphasizes Databricks, Spark, Delta Lake, Python, and Git-based DevOps, with strong collaboration across data scientists, SMEs, and engineering teams to productionize models and enterprise AI

Qualifications

• 15+ years of experience in data/AI engineering within insurance or a related domain.
• Proficient in building scalable data pipelines and ML/LLM solutions.

Responsibilities

• Design, build, test, and maintain scalable data pipelines and data products using Databricks, Spark/PySpark, Delta Lake, SQL, and Python.
• Perform exploratory and advanced data analysis to identify patterns, anomalies, trends, relationships, and opportunities within complex insurance datasets.
• Build reliable ingestion, transformation, integration, and data-quality processes across structured and unstructured data.
• Work with large-scale datasets across cloud data platforms, APIs, files, databases, and enterprise applications.
• Apply sound practices around data quality, lineage, observability, metadata, security, and governance.
• Optimize pipelines and workloads for reliability, performance, scalability, and cost.
• Develop, evaluate, deploy, and monitor machine learning models using Python and appropriate ML frameworks.
• Understand core ML techniques including supervised and unsupervised learning, classification, regression, clustering, feature engineering, model evaluation, and model monitoring.
• Translate business problems into analytical or machine-learning approaches and determine when traditional analytics, ML, or Generative AI is most appropriate.
• Work with data scientists, business SMEs, and engineering teams to productionize models and analytical solutions.
• Design and implement enterprise LLM applications, including Retrieval-Augmented Generation (RAG), document processing, summarization, extraction, classification, conversational assistants, and agentic workflows.
• Develop solutions using LLM APIs and frameworks, with experience in prompt engineering, embeddings, vector search, chunking, grounding, tool/function calling, and structured outputs.
• Understand evaluation techniques for LLM solutions, including accuracy, relevance, hallucination risk, latency, cost, security, and responsible AI considerations.
• Integrate structured enterprise data and unstructured content into secure and governed AI solutions.
• Build reusable AI components and APIs that can be incorporated into broader enterprise applications.

Skills

Python

SQL

Databricks

LLMs/Generative AI

Azure

Education

Bachelor's or Master's degree in Computer Science, Data Science, AI, Engineering, or related field

Tools

Azure Databricks

Azure AI services

MLflow/MLOps

Vector databases

Job description

SANS Consulting Services, Inc. seeks a Senior Data & AI / LLM Engineer to design, build, and operationalize data, ML, and Generative AI solutions in the insurance domain.

This is a hands-on engineering role spanning the full lifecycle from problem understanding to production deployment on Azure. The role emphasizes Databricks, Spark, Delta Lake, Python, and Git-based DevOps, with strong collaboration across data scientists, SMEs, and engineering teams to productionize models and enterprise AI