Senior Consultant - Assessment Developer

Firstsource; Hyderabad; On-site; INR 8,00,000 - 12,00,000; Full time

Job summary

A leading assessment company based in Hyderabad is looking for a professional to manage item development and scoring activities. You will gather and evaluate feedback, approve test items, and design assessments. The ideal candidate should have experience in test development and be skilled in managing client relationships. The role involves extensive coordination with committees and staff training to ensure high-quality outcomes.

Responsibilities

• Write and review items, gather feedback, and evaluate item acceptability.
• Participate in constructed-response scoring activities with faculty consultants.
• Approve items for tests, evaluating content and psychometric properties.
• Devise strategies for improving item writer results and lead training meetings.
• Design and develop new assessments, working with project teams.
• Write rules for test creation systems and assemble test pools.
• Respond to Supervisor Irregularity Reports and candidate inquiries.
• Work with client committees to organize meetings and develop training materials.
• Direct test development activities as a lead for program teams.
• Manage the item evaluation process and improve item quality.

Job description

Responsibilities

• Write and review items, gather and resolve feedback from multiple sources on items and evaluate item acceptability after testing
• Participate in and manage constructed-response scoring activities, including work with faculty consultants or state department staff
• Approve items for use on tests, evaluating both content and psychometric properties
• Devise strategies for improving outside item writer results; develop item writer training materials; plan and lead item writer training meetings; monitor work with outside item writers
• Design and develop new assessments and innovative products and services; develop new blueprints and item types, working with project team and client
• Write rules for test creation system, assemble pretests, tests and/or Computer-Adaptive Testing (CAT) pools; review tests and participate in CAT simulation activities; assist in preparation of Special Test Additions
• Respond to Supervisor Irregularity Reports (SIRs) and candidate inquiries, review responses to candidate inquiries to ensure accuracy and appropriate responses; investigate possible copyright violations; review and make recommendations for security cases
• Work with client committees -- organizing meetings, recruiting and training committee members, recommending committee members, organizing review materials, developing training materials and agendas, explaining and summarizing analysis results and advising on measurement issues
• Work directly with client content representatives to obtain signoff on items and tests; may attend client launch meetings, planning meetings and update meetings
• Plan and develop program publications and interpretive test preparation materials
• Participate in teacher training activities
• Plan and conduct reliability, validity or comparability studies
• Train others in application of item statistics and assembly of tests
• Work with Statistics staff during the test assembly process to obtain signoff on statistical parameters of forms
• Plan, manage and direct test development activities as a lead for one or more program teams, possibly as a member or leader of a test creation team
• Manage the item evaluation process for one or more programs, use feedback from committee meetings and department staff to improve item quality for a program
• Make recommendations on scoring problem items
• Coach staff as appropriate
• Serve on policy and planning committees with increasing responsibility
• Serve as an organization s spokesperson on matters of test development in field of specialty
• Direct projects, delegate work, and monitor progress
• Create, implement, and monitor item development plans
• Undertake and oversee small special development projects
• Monitor budget requirements for one or more projects
• Adhere to ethical standards and comply with the laws and regulations applicable to your job function