Principal AI|ML Engineer - Model Behavior and Evaluation

Hitachi, Ltd.; Bengaluru; Hybrid; INR 1,800,000 - 2,400,000; Full time

Benefits offered by this job

Flexible work schedules

Remote work options

Paid time off and holidays

Learning & development programs

Competitive salary

Medical and life insurance

Job summary

GlobalLogic, a Hitachi Group Company, invites passionate AI developers to join the Media Products team. You will own the evaluation framework for LLM-powered agents, tracing model behavior, costs, and quality across the platform.

The role emphasizes designing prompts, skills, and agent roles to balance performance and expense. The team works on cloud-based, AI-augmented media lifecycle solutions, with opportunities to collaborate across global centers.

Qualifications

• Real experience evaluating LLM and AI systems in production.
• Fluency with agent architectures, prompting, and tool/function calling.
• Strong Python and comfort with tracing/observability tooling (OpenTelemetry, Logfire or similar).
• Judgment on model cost versus quality at scale.

Responsibilities

• Build our evaluation framework: offline evals, regression suites, and online quality signals for agents and the LLM gateway.
• Own observability of model behavior: what the agent did, why, where it drifted, and what it cost.
• Drive prompt, skill, and agent-role design and the model selection and cost/quality tradeoffs behind them.
• Turn production failures into eval cases so quality compounds.

Skills

LLM evaluation

Agent architectures

Python

Cost vs quality

Tools

OpenTelemetry

Logfire

Job description

Job Description

GlobalLogic, a Hitachi Group Company, is a trusted digital engineering partner to the world’s largest and most
forward-thinking companies. We promise a people-first culture of caring, flexibility, and personal and professional growth.

GlobalLogic, a Hitachi Group Company and trusted digital engineering partner, promises a people-first culture of caring,
flexibility, and growth. GlobalLogic invites passionate problem solvers to join us in engineering impact through intelligent
products, platforms, and services.

GlobalLogic is the digital engineering company that promises a people-first culture of professional and personal growth. We seek
passionate problem solvers who are energized by meaningful challenges. Using the power of design and complex software
engineering, we create a better future for people and the planet.

Our customer is a global pioneer in media technology, delivering industry-leading video and audio editing solutions to premier entertainment brands and major hollywood studios. Recognized with accolades ranging from Oscars and Grammys to NAB’s Product of the Year, they continue to set the standard for digital media innovation.

For over 15 years, the strategic partnership with GlobalLogic has been instrumental for our customer in driving product development across their core platforms in audio\video editing and media workflow management. Our customer is expanding its collaboration with GlobalLogic to engineer next-generation, cloud-based, and AI-augmented media lifecycle management solutions. This effort is supported by a growing team of specialized engineering talent in India dedicated to accelerating client's cloud and AI roadmap.

Requirements

We are looking for a senior AI developers to be a member of the Media Products development team, which creates and maintains several products in our Media product portfolio on audio\video editing and media workflow management areas. The team works on LLM-powered agents and need someone who owns whether they actually work well. You'll define how we measure and observe model and agent behavior across the platform.
You should have

• Real experience evaluating LLM and AI systems in production.
• Fluency with agent architectures, prompting, and tool/function calling.
• Strong Python and comfort with tracing/observability tooling (OpenTelemetry, Logfire or similar).
• Judgment on model cost versus quality at scale.

Nice to have: LiteLLM/pydantic-ai, Temporal or similar workflow engines, MCP.

Job Responsibilities

• Build our evaluation framework: offline evals, regression suites, and online quality signals for agents and the LLM gateway.
• Own observability of model behavior: what the agent did, why, where it drifted, and what it cost.
• Drive prompt, skill, and agent-role design and the model selection and cost/quality tradeoffs behind them.
• Turn production failures into eval cases so quality compounds.

What we offer

Exciting Projects: We focus on industries like High-Tech, communication, media, healthcare, retail and telecom. Our customer list is full of fantastic global brands and leaders who love what we build for them.

Collaborative Environment: You Can expand your skills by collaborating with a diverse team of highly talented people in an open, laidback environment — or even abroad in one of our global centers or client facilities!

Work-Life Balance: GlobalLogic prioritizes work-life balance, which is why we offer flexible work schedules, opportunities to work from home, and paid time off and holidays.

Professional Development: Our dedicated Learning & Development team regularly organizes Communication skills training(GL Vantage, Toast Master),Stress Management program, professional certifications, and technical and soft skill trainings.

Excellent Benefits: We provide our employees with competitive salaries, family medical insurance, Group Term Life Insurance, Group Personal Accident Insurance , NPS(National Pension Scheme ), Periodic health awareness program, extended maternity leave, annual performance bonuses, and referral bonuses.

Fun Perks: We want you to love where you work, which is why we host sports events, cultural activities, offer food on subsidies rates, Corporate parties. Our vibrant offices also include dedicated GL Zones, rooftop decks and GL Club where you can drink coffee or tea with your colleagues over a game of table and offer discounts for popular stores and restaurants!

About GlobalLogic

GlobalLogic is a full-lifecycle product development services leader that combines chip-to-cloud software engineering expertise and vertical industry experience to help our customers design, build, and deliver their next-generation products and digital experiences. We expertly integrate design, complex engineering, and agile delivery capabilities to deliver superior business outcomes for global brands in telecom, automotive, healthcare, technology, media and entertainment, manufacturing, and semiconductor industries.

Headquartered in Silicon Valley, GlobalLogic employs over 25,000 designers and engineers across the globe. Analysts like NASSCOM and Zinnov have recognized us for being a top company in our field, and we are consistently nominated as a preferred employer by both global HR consultative firms and local job boards. By creating a work environment that is exciting and flexible, and by fostering growth through ongoing learning and development programs, we empower our employees to achieve both their professional and personal goals.

At GlobalLogic, we make amazing products — and careers.