Senior Engineering Manager

Story Terrace Inc.; Mumbai; On-site; INR 4,000,000 - 8,000,000; Full time

Benefits offered by this job

Healthcare plan

Team of high performers

Leadership opportunities

Job summary

AryaXAI is seeking a Senior Engineering Manager to lead the platform scale and its components, scaling multiple AI models for startups, SMEs, and highly regulated industries. You will own architecture, data pipelines, and end-to-end ML infra, ensuring reliability and production readiness.

You’ll collaborate with R&D, data science, and frontend teams, mentor juniors, and continuously raise the bar on performance, scalability, and SLAs across the stack.

Qualifications

• Bachelor’s degree in Computer Science or Engineering or related field.
• Strong Python programming and distributed system fundamentals.
• Experience designing and scaling enterprise-grade ML infra and platforms.

Responsibilities

• Lead platform scale and components, coordinating multiple AI model deployments.
• Serve as SPOC with R&D, design productized components and scale them.
• Architect and scale AI inference, data processing, explainability, and monitoring.
• Drive multiple inferences optimizations for speed and latency at scale.
• Oversee scrum processes, collaboration with data science and frontend teams.
• Mentor juniors and middle managers, improve product and architecture.
• Maintain high standards for reliability, SLAs, and production readiness.

Skills

Python

Distributed computing

Cloud computing

CI/CD pipelines

Kubernetes

Leadership

MongoDB

Multi-cloud

Data processing

Model deployment

Education

CS/Engineering degree

Tools

Docker

Kubernetes

AWS

Azure

GCP

On-premises

MongoDB

Job description

AryaXAIoffersoneofthemostreliable,safe,andperformantplatformsforbuildingExpertAIAgents&Modelsformission-criticalusecases.WestandattheforefrontofAIinnovation,revolutionizingAIformission-criticalbusinessesbysolvingthemostcriticalchallengesinAIinterpretability,alignment,andAIrisk.ThroughourresearchlabsinMumbai,Paris,andLondon,weproducestate-of-the-arttechniques,models,andopen-sourcetools.Theplatformintegratesthesecomponentsandscalesthemtotheusersandusageasneeded.WeareardentsupportersofOSS,andwenotonlyopen-sourceourresearchbutalsointegratemultipleOSStodeliverthescale.

AtAryaXAI,everyonecontributeshands-ontoourmissioninaflatorganizationalstructurethatvaluescuriosity,initiative,andexceptionalperformance.

Qualifications:

WearenowlookingforhighlyexperiencedSeniorEngineeringManagerswhocanleadtheplatformscaleandcomponents,andmakeittheindustrybestintherelevantcomponents.Idealcandidatesshouldhaveatleast5+yearsofexperienceworkingwithproductsthatrequireheavyengineeringandscalingrequirements.PreferenceisfromaproductbackgroundwithstrongdisciplinaryoundthestackandPRquality.

• 5+yearsofexperienceinbuildinganddeployingenterprise-grademachinelearninginfra,SaaSsoftware,dataanalyticssolutions,oronlineplatforms
• 2+yearsofexperienceinbuildingLLMinfraorhigh-volumeAIinferencecomponents.
• AcademicdegreeinComputerScience,Engineering,orarelatedfield
• StrongbackgroundinPythonprogramming,Distributedcomputing,Engineering,bigdataprocessing,andcloudcomputing(AWS,Azure,GCP,on-premises)
• Experienceinoptimizing,scaling,andreliabilityoflarge-scalesystemsforvariousdatamodalitiesandAImodels.
• StrongfundamentalsanddisciplineinCI/CDpipelines,containerization(Docker,Kubernetes),andmulti-cloudenvironments.
• Proventrackrecordinproductmanagementindesigninganddeliveringcomplex,high-performancesolutionsforlarge-scaleenterprisecustomerswithoutfaultsandtheabilitytoauto-scalethesystemsthroughdeliveringtheessentialSLAsinproductionduringinference
• Programmingskills-expertinPythonandsolidcodingpractices
• DataEngineering-expertinMongoDBandstrongfundamentalsindatalakes,datastorage,ETLpipelines,andbuildingreal-timedatapipelines.
• Strongmaterialskills,excellentcommunication,collaboration,andleadershipskillswiththeabilitytoleadteams,mentorjuniors,andworkwithotherteams.
• Strongsystemarchitecturebackgroundthatsupportsscalinginregulatedindustries.
• ExperienceinscalingAI/MLproductionsystemsusingclassicMLmodels,LLMs,andDeepLearningmodelsontraditionalhardwareandhigh-performancecomputing.

Rolesandresponsibilities

AsSrEngineeringManager,you'llbethemainSPOCforalltheengineeringeffortsbehindtheAryaXAIplatform,servingcustomersinSaaSandon-premisemodesandscalingmultipleAImodelsinstartups,SMEs,andhighlyregulatedindustries.

• You'llberesponsiblefordesigning,modifying,andscalingarchitecture,aswellasdesigningandimplementingscalableinfrastructureforAI/MLsolutionsanddataengineering.
• You'llbetheSPOCwiththeR&Dteam,collectingtheproductizedcomponentsandaddingandscalingthesecomponentsontheplatform.
• ArchitectandscaleAIinferenceplatformandrelatedcomponentsforalldatamodalitieslikeTabular,text,image,video,etc.
• You'llberesponsiblefordesigningtheAIOpsandAIInferencingOps-modelbuilding,datapreprocessing,modelinferencing,explainability,monitoring,alignment,riskmanagementcomponents.
• You'llworkonrunningmultipleoptimizationsoninferencespeedandlatenciestoservemultipleAImodels-LLMs,DLmodels,classicMLmodels,etc.
• You'llmanageproductdevelopmentactivities,includingscrumreviewsandproductivityoptimizationacrossengineering,aswellascollaboratewithR&D/datascienceandfront-endteams.
• You'llmentorandguidejuniorsandmiddlemanagers.
• You'llcontinuouslyimprovethestandardsoftheproduct,aswellasthearchitecture,culture,andexperience.

Whatyou’llget:

• Highlycompetitiveandmeaningfulcompensationpackage
• Oneofthebesthealthcareplansthatcoversnotonlyyoubutalsoyourfamily,andoffersthebestLifeinsuranceplans.
• Agreatteam
• Micro-entrepreneurialtasksandresponsibilities.
• Careerdevelopmentandleadershipopportunities