Senior MLOps Gen AI Engineer

EPAM Systems; Chennai District; On-site; INR 1,000,000 - 2,000,000; Full time

Job summary

EPAM Systems is seeking a Senior MLOps Gen AI Engineer in Chennai, India. In this role, you will support the development and deployment of AI tools, ensuring scalable production pipelines for machine learning and generative AI applications. The ideal candidate has 5 to 9 years of experience in MLOps, strong skills in AWS and Azure, and is capable of containerization with Docker and implementation with Terraform to enhance business value through AI solutions. You will work collaboratively across teams to operationalize AI models effectively.

Qualifications

• 5 to 9 years of extensive experience in MLOps and data integration.
• Proven track record in designing/deploying scalable ML production pipelines.
• Competency in cloud platforms for infrastructure and model deployment.
• Familiarity with data orchestration in Azure and Snowflake.

Responsibilities

• Convert ML and generative AI experiments into production pipelines.
• Develop and maintain code repositories and reusable components.
• Design CI/CD pipelines in AWS or Azure for models and APIs.
• Automate infrastructure provisioning using Terraform.

Skills

MLOps

Data integration

AWS

Azure

Docker

Terraform

Data orchestration

Generative AI

Problem-solving

Job description

We are looking for a Senior MLOps Gen AI Engineer to support the development and deployment of AI tools.

You will work at the crossroads of data science, engineering, and cloud infrastructure to build scalable and automated AI systems that deliver business value. Your role will involve collaborating with data scientists, stakeholders, and cloud engineers to turn AI experiments into stable and efficient applications. Join us to contribute to predictive analytics, generative AI solutions, and interactive dashboards that empower business leaders.

Responsibilities

• Collaborate with data scientists to convert machine learning and generative AI experiments into scalable production pipelines
• Develop and maintain shared code repositories and reusable components
• Design and implement CI/CD pipelines in AWS or Azure for deploying models, APIs, and generative AI tools
• Build and manage data pipelines and DataOps processes
• Containerize applications with Docker and deploy them on cloud-native platforms
• Automate infrastructure provisioning using Terraform and manage database schemas in Azure and Snowflake
• Deploy and operate generative AI applications such as chatbots, retrieval-augmented generation systems, and predictive analytics tools
• Implement monitoring, observability, and explainability mechanisms to ensure system reliability
• Establish alerting, rollback strategies, and observability tools to maintain system stability
• Participate in code reviews and recommend improvements to workflows

Requirements

• Extensive experience in MLOps and data integration with 5 to 9 years in related roles
• Proven background in designing and deploying scalable machine learning production pipelines
• Competency in cloud platforms such as AWS and Azure for infrastructure and model deployment
• Skills in containerization technologies like Docker and infrastructure as code using Terraform
• Familiarity with data orchestration and management in Azure and Snowflake environments
• Knowledge of generative AI fundamentals and practical deployment experience
• Ability to collaborate effectively with data scientists and engineers to operationalize AI models
• Strong problem-solving skills and attention to system observability and reliability

Nice to have

• Experience with large language models (LLM)
• Understanding of retrieval-augmented generation (RAG) systems