DevOps Engineer (Senior)

HYCU, Inc.; Bengaluru; On-site; Confidential; Full time

Benefits offered by this job

Medical Insurance

Equity Program

Time Off

Job summary

HYCU, Inc. is seeking an ML Infrastructure Engineer to design, build and operate the infrastructure for Generative AI workloads in production. You will ensure performance, scalability, reliability, and cost efficiency of AI systems in a cloud-native environment.

In this role, you will work on large-scale AI workloads, including LLMs and data pipelines, and collaborate with AI, data, and DevOps teams to maintain end-to-end system health and observability.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 6–9 years of experience in infrastructure, platform, or ML engineering roles.
• Experience supporting production AI or data-intensive systems at scale.
• Hands-on experience with cloud platforms and modern infrastructure tooling.
• Familiarity with CI/CD pipelines and infrastructure automation.

Responsibilities

• Design and operate infrastructure for training, serving, and scaling ML/Generative AI models.
• Build and optimize model serving and inference pipelines for Large Language Models.
• Enable scalable experimentation, evaluation, and deployment of AI models.
• Implement monitoring, logging, and alerting for AI infrastructure and model performance.
• Collaborate with AI, data, and DevOps teams to ensure end-to-end system reliability.
• Design and maintain scalable infrastructure for AI and ML workloads.
• Optimize inference performance, resource utilization, and operational costs.
• Implement observability solutions for model and infrastructure health.
• Partner with AI engineers to productionize models and workflows.
• Identify infrastructure risks and drive improvements proactively.

Skills

Cloud platforms

Performance optimization

Observability

CI/CD

ML serving systems

Infrastructures for AI

Cost management

Reliability engineering

Education

Bachelor's or Master's degree in CS/Engineering

Tools

Kubernetes

Docker

Cloud-native tooling

Job description

HYCU is the fastest-growing leader in the multi-cloud and SaaS data protection as a service industry. By bringing true SaaS-based data backup and recovery to on-premises, cloud-native, and SaaS IT environments, the company provides unrivaled data protection, migration, disaster recovery, and ransomware protection to thousands of companies worldwide. The company's award-winning R-Cloud platform eliminates complexity, risk, and the high cost of legacy-based solutions, providing data protection simplicity to make it the #1 SaaS Data Protection platform. With an industry leading NPS score of 91, HYCU has raised $140M in VC funding to date and is based in Boston, Mass. Learn more at www.hycu.com.

Overview

We are seeking a ML Infrastructure Engineer that will be responsible for designing, building, and operating the infrastructure that supports Generative AI and machine learning workloads in production. This role ensures performance, scalability, reliability, and cost efficiency of AI systems.

We are building next-generation Generative AI products that deliver actionable data insights at enterprise scale. Our platform runs large-scale AI workloads, including Large Language Models (LLMs), data pipelines, and AI agents, on modern cloud-native infrastructure. We focus on building reliable, scalable, cost-efficient, and production-grade AI infrastructure.

Location:

• Bangalore, India (Hybrid; 3 days onsite/2 days remote)

What You’ll Do:

• Design and operate infrastructure for training, serving, and scaling machine learning and Generative AI models
• Build and optimize model serving and inference pipelines for Large Language Models
• Enable scalable experimentation, evaluation, and deployment of AI models
• Implement monitoring, logging, and alerting for AI infrastructure and model performance
• Collaborate with AI, data, and DevOps teams to ensure end-to-end system reliability
• Design and maintain scalable infrastructure for AI and ML workloads
• Optimize inference performance, resource utilization, and operational costs
• Implement observability solutions for model and infrastructure health
• Partner with AI engineers to productionize models and workflows
• Identify infrastructure risks and drive improvements proactively

What We’re Looking For:

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
• 6–9 years of experience in infrastructure, platform, or ML engineering roles
• Experience supporting production AI or data-intensive systems at scale
• Hands-on experience with cloud platforms and modern infrastructure tooling
• Strong experience with cloud platforms and cloud-native infrastructure
• Hands-on experience with containerization and orchestration technologies
• Experience deploying and scaling ML or AI model serving systems
• Strong understanding of performance optimization, cost management, and reliability engineering
• Familiarity with CI/CD pipelines and infrastructure automation

Attributes of a Successful HYCUer in this role:

• Self-starter and strategic thinker who thinks outside the box
• Takes responsibility and ownership for driving successful outcomes. You’re results-driven with a winning attitude
• Team player! You have excellent people and management skills to interact with staff, colleagues, cross-functional teams and third parties
• Hands-on and builders' mentality with an entrepreneurial mindset and intrinsic motivation
• Obsessed with being customer-focused – We know our customers and are advocates for their voice and point of view across HYCU
• Intellectual curiosity, always open for continuous learning/growth mindset

Who We Are:

Our Core Values: Authenticity, Grit and Empathy are at the heart of everything we do at HYCU. All of us at HYCU take ownership in shaping and contributing to our culture. We pride ourselves in developing an inclusive and diverse company that supports our employees and customers to do extraordinary things.

The following is how we approach each Core Value:

• Authenticity – To be authentic means to be who we are and do it well. Focus your energy on being who YOU are. Be true to yourself. Authenticity also extends to our products. Understanding where we are truly the best fit for our customers and when we are not. And finally, authenticity in relationships: ensuring that we are honest and do what we say we’re going to do.
• Grit – To win we need to want it. Every team member needs to be able to jump in and help at every turn. Whether it’s staying late to help a colleague or customer or finding a better process and making sure it’s communicated cross-functionally. You just have to do it and love it…and never stop trying.
• Empathy – We need to care about each other, about our clients, about our business, and about the world around us. That might seem like a tall order, but if we don’t live in a constant state of empathy, if we don’t strive to truly put ourselves in another person’s shoes, we cannot truly serve the market.

"We are at our best when we stay true to our Core Values."~ Simon Taylor, CEO

What We Offer:

Come work for one of CRN’s “Cloud 100 Companies for 2026”. At HYCU you’ll have the opportunity to build your career with a “Visionary” B2B SaaS company from Gartner’s Magic Quadrant for Enterprise BackUp. HYCU provides an excellent benefits package including Medical Insurance, generous time off, and more. We offer career development programs and an inclusive global culture. All our employees participate in our equity program.