Senior Data Scientist, AI & Azure Analytics

Lantern; Dallas (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Lantern is seeking a hands‑on, client‑facing Senior Data Scientist to design, develop, and operationalize advanced analytics, ML, generative AI, and agentic AI solutions using Azure Databricks and the Microsoft AI ecosystem. You will partner with client stakeholders, data engineers, and application teams to translate business problems into secure, governed, scalable, and explainable AI solutions.

You will lead discovery sessions, perform data preparation and feature engineering, and build

Qualifications

• 5+ years of experience developing and delivering data science, machine learning, or AI solutions.
• Strong hands-on experience with Azure Databricks for data preparation, distributed model development, experiment tracking, model lifecycle management, and production deployment.
• Advanced proficiency in Python and SQL, with practical experience in PySpark and frameworks such as scikit‑learn, XGBoost, TensorFlow, or PyTorch.
• Strong foundation in statistics, supervised and unsupervised learning, feature engineering, model evaluation, explainability, and experimental design.
• Experience developing generative AI solutions using large language models, embeddings, vector databases, prompt engineering, evaluation, and agentic patterns.
• Working knowledge of Microsoft Azure AI Foundry, Azure OpenAI, Microsoft Fabric, OneLake, Power BI, and broader Azure data and AI ecosystem.
• Experience with MLOps or LLMOps, CI/CD, model serving and monitoring, data governance, Unity Catalog, security, responsible AI, performance, and cost optimization.
• Strong consulting, communication, visualization, documentation, problem-solving, and stakeholder-management skills, with the ability to explain complex models to technical and executive audiences.

Responsibilities

• Lead discovery sessions to define analytical problems, success metrics, data requirements, experimentation plans, and production roadmaps.
• Explore and prepare structured and unstructured data; perform feature engineering, statistical analysis, and model selection using Python, SQL, Spark, and Databricks notebooks.
• Build, evaluate, and tune predictive, forecasting, optimization, natural language processing, computer vision, generative AI, and agentic AI solutions.
• Use Azure Databricks capabilities such as Delta Lake, Unity Catalog, MLflow, Feature Engineering, Model Serving, Mosaic AI, and vector search to create governed, production‑ready solutions.
• Integrate solutions with Microsoft Azure AI Foundry, Azure OpenAI, Microsoft Fabric, OneLake, Power BI, and Azure services as appropriate.
• Implement MLOps and LLMOps practices including source control, automated testing, CI/CD, model registration, deployment, monitoring, drift detection, responsible AI, and cost optimization.
• Communicate findings and model behavior through clear visualizations, executive‑ready narratives, demonstrations, and technical documentation.
• Own assigned workstreams, manage risks and dependencies, and collaborate with client teams to drive adoption and measurable business outcomes.
• Contribute to proposals, reusable accelerators, technical standards, peer reviews, mentoring, and the growth of Lantern’s Databricks and Microsoft AI practices.

Skills

Azure Databricks

Python

SQL

PySpark

Machine Learning

Generative AI

MLOps

Data Visualization

Communication

Tools

Delta Lake

Unity Catalog

MLflow

Power BI

Azure OpenAI

Microsoft Fabric

Job description

Lantern is seeking a hands‑on, client‑facing Senior Data Scientist to design, develop, and operationalize advanced analytics, ML, generative AI, and agentic AI solutions using Azure Databricks and the Microsoft AI ecosystem. You will partner with client stakeholders, data engineers, and application teams to translate business problems into secure, governed, scalable, and explainable AI solutions.

You will lead discovery sessions, perform data preparation and feature engineering, and build