Senior Data Scientist (Agentic AI + Azure)

SoftServe; Town of Poland (NY); On-site; USD 140,000 - 180,000; Full time

Job summary

SoftServe is seeking a GenAI Solutions Architect to design and deliver enterprise-grade AI solutions within its AI and Data Science Center of Excellence. You will work on RAG pipelines, agentic workflows, and fine-tuned foundation models for top-tier clients.

You will optimize performance, build scalable data pipelines, and collaborate with ML engineers and architects to productionize solutions. Strong Python, Azure AI Foundry, LangChain/ LangGraph, and Azure ML experience are essential.

Qualifications

• Master’s degree in Computer Science, Applied Mathematics, Data Science, Engineering, or related field.
• Strong Python proficiency with hands-on experience using Azure AI Foundry and LangChain or LangGraph for building GenAI applications.
• Solid experience with RAG pipeline design, including Azure AI Search, vector databases, embedding models, and retrieval optimization strategies.
• Hands-on experience with Azure ML for model training, evaluation, and deployment, including pipeline automation and model monitoring.
• Practical experience with prompt engineering, model evaluation tools (RAGAS, TruLens, or similar), and responsible AI practices.
• Experience with agentic AI frameworks and multi-agent orchestration patterns using LangGraph, Semantic Kernel, or Azure AI Agent Service.
• Solid understanding of Azure cloud architecture, data services, and security best practices for enterprise AI workloads.
• Upper-intermediate or higher proficiency in English, both spoken and written.

Responsibilities

• Design and deliver enterprise-grade Generative AI solutions on Azure, including RAG pipelines, agentic workflows, and conversational AI systems.
• Experiment with, evaluate, and fine-tune foundation models to optimize performance, accuracy, and cost for enterprise use cases.
• Build scalable data pipelines for GenAI workloads, including document ingestion, chunking, embedding generation, and vector index management.
• Collaborate with ML Engineers, Architects, and stakeholders to ensure reliable deployment from proof-of-concept to production.
• Design and implement multi-agent AI systems and orchestration patterns that automate complex business processes at scale.
• Apply prompt engineering, model evaluation frameworks, and guardrails to ensure responsible, accurate AI output in production.
• Contribute to CoE best practices, reusable accelerators, and internal knowledge-sharing.

Skills

Python

English proficiency

Education

Master’s degree in Computer Science

Tools

Azure AI Foundry

LangChain

LangGraph

Azure ML

RAGAS

TruLens

Semantic Kernel

Azure AI Agent Service

Job description

About The Role

In this role, you will design and deliver enterprise-grade Generative AI solutions — from RAG pipelines and agentic workflows to fine-tuned foundation models — within SoftServe's AI and Data Science Center of Excellence, a team of 170+ experts including Data Scientists, ML Engineers, and Architects. Working at the intersection of cutting-edge GenAI research and production engineering, you'll translate complex business challenges into scalable AI systems that drive measurable impact for world-leading clients.

Responsibilities

• Design and develop end-to-end Generative AI solutions on Azure — including RAG pipelines, agentic workflows, and conversational AI systems — ensuring alignment with client business objectives and production standards
• Experiment with, evaluate, and fine-tune foundation models to optimize performance, accuracy, and cost efficiency for diverse enterprise use cases
• Build scalable data pipelines for GenAI workloads, including document ingestion, chunking strategies, embedding generation, and vector index management
• Collaborate with ML Engineers, Architects, and client stakeholders to ensure reliable deployment of GenAI solutions and smooth handoff from proof-of-concept to production
• Design and implement multi-agent AI systems and agentic orchestration patterns that automate complex business processes at scale
• Apply prompt engineering, model evaluation frameworks, and guardrail mechanisms to ensure responsible, accurate, and consistent AI output in production
• Contribute to CoE best practices, reusable solution accelerators, and internal knowledge-sharing

Requirements

• Strong Python proficiency with hands-on experience using Azure AI Foundry and LangChain or LangGraph for building GenAI applications
• Solid experience with RAG pipeline design, including Azure AI Search, vector databases, embedding models, and retrieval optimization strategies
• Hands-on experience with Azure ML for model training, evaluation, and deployment, including pipeline automation and model monitoring
• Practical experience with prompt engineering, model evaluation tools (RAGAS, TruLens, or similar), and responsible AI practices
• Experience with agentic AI frameworks and multi-agent orchestration patterns using LangGraph, Semantic Kernel, or Azure AI Agent Service
• Solid understanding of Azure cloud architecture, data services, and security best practices for enterprise AI workloads
• Master’s degree in Computer Science, Applied Mathematics, Data Science, Engineering, or a related field
• Upper-intermediate or higher proficiency in English, both spoken and written

SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.