Senior Data Scientist (Agentic AI + Azure)

SoftServe Inc.

Town of Poland (NY)

On-site

USD 140,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

SoftServe is seeking a GenAI Solutions Architect to design and deliver enterprise-grade AI solutions within its AI and Data Science Center of Excellence. You will work on RAG pipelines, agentic workflows, and fine-tuned foundation models for top-tier clients.

You will optimize performance, build scalable data pipelines, and collaborate with ML engineers and architects to productionize solutions. Strong Python, Azure AI Foundry, LangChain/ LangGraph, and Azure ML experience are essential.

Qualifications

  • Master’s degree in Computer Science, Applied Mathematics, Data Science, Engineering, or related field.
  • Strong Python proficiency with hands-on experience using Azure AI Foundry and LangChain or LangGraph for building GenAI applications.
  • Solid experience with RAG pipeline design, including Azure AI Search, vector databases, embedding models, and retrieval optimization strategies.
  • Hands-on experience with Azure ML for model training, evaluation, and deployment, including pipeline automation and model monitoring.
  • Practical experience with prompt engineering, model evaluation tools (RAGAS, TruLens, or similar), and responsible AI practices.
  • Experience with agentic AI frameworks and multi-agent orchestration patterns using LangGraph, Semantic Kernel, or Azure AI Agent Service.
  • Solid understanding of Azure cloud architecture, data services, and security best practices for enterprise AI workloads.
  • Upper-intermediate or higher proficiency in English, both spoken and written.

Responsibilities

  • Design and deliver enterprise-grade Generative AI solutions on Azure, including RAG pipelines, agentic workflows, and conversational AI systems.
  • Experiment with, evaluate, and fine-tune foundation models to optimize performance, accuracy, and cost for enterprise use cases.
  • Build scalable data pipelines for GenAI workloads, including document ingestion, chunking, embedding generation, and vector index management.
  • Collaborate with ML Engineers, Architects, and stakeholders to ensure reliable deployment from proof-of-concept to production.
  • Design and implement multi-agent AI systems and orchestration patterns that automate complex business processes at scale.
  • Apply prompt engineering, model evaluation frameworks, and guardrails to ensure responsible, accurate AI output in production.
  • Contribute to CoE best practices, reusable accelerators, and internal knowledge-sharing.

Skills

Python
English proficiency

Education

Master’s degree in Computer Science

Tools

Azure AI Foundry
LangChain
LangGraph
Azure ML
RAGAS
TruLens
Semantic Kernel
Azure AI Agent Service

Job description

About The Role

In this role, you will design and deliver enterprise-grade Generative AI solutions — from RAG pipelines and agentic workflows to fine-tuned foundation models — within SoftServe's AI and Data Science Center of Excellence, a team of 170+ experts including Data Scientists, ML Engineers, and Architects. Working at the intersection of cutting-edge GenAI research and production engineering, you'll translate complex business challenges into scalable AI systems that drive measurable impact for world-leading clients.

Responsibilities
  • Design and develop end-to-end Generative AI solutions on Azure — including RAG pipelines, agentic workflows, and conversational AI systems — ensuring alignment with client business objectives and production standards
  • Experiment with, evaluate, and fine-tune foundation models to optimize performance, accuracy, and cost efficiency for diverse enterprise use cases
  • Build scalable data pipelines for GenAI workloads, including document ingestion, chunking strategies, embedding generation, and vector index management
  • Collaborate with ML Engineers, Architects, and client stakeholders to ensure reliable deployment of GenAI solutions and smooth handoff from proof-of-concept to production
  • Design and implement multi-agent AI systems and agentic orchestration patterns that automate complex business processes at scale
  • Apply prompt engineering, model evaluation frameworks, and guardrail mechanisms to ensure responsible, accurate, and consistent AI output in production
  • Contribute to CoE best practices, reusable solution accelerators, and internal knowledge-sharing
Requirements
  • Strong Python proficiency with hands-on experience using Azure AI Foundry and LangChain or LangGraph for building GenAI applications
  • Solid experience with RAG pipeline design, including Azure AI Search, vector databases, embedding models, and retrieval optimization strategies
  • Hands-on experience with Azure ML for model training, evaluation, and deployment, including pipeline automation and model monitoring
  • Practical experience with prompt engineering, model evaluation tools (RAGAS, TruLens, or similar), and responsible AI practices
  • Experience with agentic AI frameworks and multi-agent orchestration patterns using LangGraph, Semantic Kernel, or Azure AI Agent Service
  • Solid understanding of Azure cloud architecture, data services, and security best practices for enterprise AI workloads
  • Master’s degree in Computer Science, Applied Mathematics, Data Science, Engineering, or a related field
  • Upper-intermediate or higher proficiency in English, both spoken and written

SoftServe is an equal opportunity employer. Qualified applicants will receive consideration regardless of race, color, ancestry, ethnicity, national origin, religion, sex, sexual orientation, gender identity or expression, age, citizenship, disability, health condition, marital or family status, veteran status, or any other characteristic protected by applicable law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GenAI Solutions Architect — Agentic AI on Azure
GenAI Solutions Architect — Agentic AI on Azure

SoftServe Inc. • Town of Poland (NY)

On-site
USD 140,000 - 180,000
Senior Data Scientist GenAI / RAG
Senior Data Scientist GenAI / RAG

Compunnel Inc. • Houston (TX)

On-site
USD 120,000 - 150,000
Senior AI Engineer - Generative AI & Agentic Systems
Senior AI Engineer - Generative AI & Agentic Systems

Life in Pittsburgh • Pittsburgh

On-site
USD 150,000 - 210,000
Sr. AI Architect
Sr. AI Architect

Ampcus, Inc • Chantilly (VA)

On-site
USD 180,000 - 260,000
Senior AI / ML Engineer - Generative AI & Azure
Senior AI / ML Engineer - Generative AI & Azure

EPAM Systems • United States

On-site
USD 120,000 - 170,000
Gen. AI Engineer
Gen. AI Engineer

KALEIDOSCOPE Innovation • Charlotte (NC)

On-site
USD 150,000 - 210,000
Artificial Intelligence Engineer
Artificial Intelligence Engineer

Qorali • Washington

On-site
USD 140,000 - 210,000
AI Engineer - Azure (Onsite)
AI Engineer - Azure (Onsite)

Cognizant Technology Solutions Corporation • Washington

On-site
USD 110,000 - 135,000
GEN AI Architect
GEN AI Architect

TechDigital Group • Charlotte (NC)

On-site
USD 150,000 - 210,000
Senior Agentic AI Engineer
Senior Agentic AI Engineer

Ethereum Technologies LLC • Tampa (FL)

On-site
USD 150,000 - 190,000