Role & responsibilities
A. Roles and Responsibilities
- Coordinate model evaluation and benchmarking activities under approved technical parameters and timelines.
- Track model performance metrics, including accuracy, precision, recall, F1 score, BLEU / ROUGE, latency, throughput, hallucination rate, robustness, bias, toxicity, safety, multilingual capability and inference cost.
- Monitor model development progress across training, fine-tuning, evaluation, validation, deployment-readiness and post-deployment monitoring.
- Track MLOps activities, including model versioning, experiment logs, evaluation records, CI/CD readiness, API readiness, monitoring dashboards and retraining requirements.
- Review compute utilisation inputs relating to GPU / TPU / HPC / cloud usage, distributed training, storage, inference infrastructure and cost optimisation.
- Coordinate with startups, technology partners, evaluation agencies and compute providers for timely submission of technical reports and benchmarking results.
- Prepare technical MIS dashboards, evaluation summaries, compute review notes and progress updates.
- Identify performance gaps, compute bottlenecks, deployment risks and MLOps-related dependencies.
B. Education
B.E. / B.Tech / M.Tech / MCA / MBA in Computer Science, IT, AI/ML, Data Science, Electronics & Communication, Computer Engineering, Software Engineering, Business Analytics or equivalent related discipline from a recognised University / Institution.
C. Desirable Skills & Experience
- Total Experience: 6 years in AI/ML projects, model evaluation, MLOps, or software systems, cloud projects, data platforms or technical programme management.
- Understanding of AI/ML lifecycle, model benchmarking, inference, deployment, monitoring and retraining.
- Familiarity with Git, MLflow, Weights & Biases, Docker, Kubernetes, CI/CD, APIs, cloud platforms, GPUs / TPUs / HPC and monitoring dashboards.