Une candidature complète en une minute
Un CV et une lettre de motivation personnalisés, prêts à envoyer.
BMC Software, Inc. in India looks for an AI evaluation engineer to build evaluation frameworks for Generative AI, create golden datasets, and integrate evals into CI pipelines. You will drive high-quality releases by defining metrics, planning tests, and ensuring reproducibility across teams.
The role emphasizes independent ownership, collaboration with DS, engineering, and product, and a strong data-driven approach to improving model quality and safety.
Looking for details about our benefits? You can learn more about them by clicking HERE
BMC empowers nearly 80% of the Forbes Global 100 to accelerate business value, faster than humanly possible. Our industry-leading portfolio unlocks human and machine potential to drive business growth, innovation, and sustainable success. BMC does this in a simple and optimized way by connecting people, systems, and data that power the world’s largest organizations so they can seize a competitive advantage.
The IZOT product line includes BMC’s Intelligent Z Optimization & Transformation products, which help the world’s largest companies to monitor and manage their mainframe systems. The modernization of mainframe is the beating heart of our product line, and we achieve this goal by developing products that improve the developer experience, the mainframe integration, the speed of application development, the quality of the code and the applications’ security, while reducing operational costs and risks. We acquired several companies along the way, and we continue to grow, innovate, and perfect our solutions on an ongoing basis.
You build the systems that tell us whether our agentic AI is good enough to ship: evaluation frameworks, golden datasets, and rubrics; automated eval harnesses in CI; and drive down failure modes such as hallucination, drift, and unsafe or non-repeatable output. You are the reason customers can trust what our agents produce. At this level you independently own well-scoped work from definition through delivery. Scope at this level: Independently owns well-scoped eval work for a feature/team from definition through delivery. Organizational impact expected: Improves outcomes for one team or project.
BMC’s culture is built around its people. We have 6000+ brilliant minds working together across the globe. You won’t be known just by your employee number, but for your true authentic self. BMC lets you be YOU!
If after reading the above, You’re unsure if you meet the qualifications of this role but are deeply excited about BMC and this team, we want to attract talents from diverse backgrounds and experience to ensure we face the world together with the best ideas!
BMC Software maintains a strict policy of not requesting any form of payment in exchange for employment opportunities, upholding a fair and ethical hiring process.
At BMC we believe in pay transparency and have set the midpoint of the salary band for this role at 4,700,000 INR. Actual salaries depend on a wide range of factors that are considered in making compensation decisions, including but not limited to skill sets; experience and training, licensure, and certifications; and other business and organizational needs.
The salary listed is just one component of BMC's employee compensation package. Other rewards may include a variable plan and country specific benefits.
We are committed to ensuring that our employees are paid fairly and equitably, and that we are transparent about our compensation practices.
We use AI technology to support parts of our recruitment process, but people—not algorithms—make all final hiring decisions. AI may assist with tasks like scheduling, screening for role alignment, or helping us manage large volumes of applications more efficiently. However, candidates are reviewed by a member of our recruitment team, and interviews and hiring decisions are always made by people. We’re committed to ensuring that technology enhances fairness, efficiency, and the candidate experience—never replaces genuine human judgment.
( Returnship@BMC )
Had a break in your career? No worries.