Evaluator

Pala Band of Mission Indians; Pala (CA); On-site; USD 55,000 - 83,000; Full time

Job summary

Pala Band Of Mission Indians Human Resources Office is seeking an Evaluator to lead the Tribal 988 project evaluation, data collection, and performance reporting. You will monitor CQI processes, develop dashboards, and coordinate federal reporting to ensure program effectiveness and compliance.

The role requires advanced data analysis, strong collaboration with diverse partners, and adherence to HIPAA and tribal policies.

Qualifications

• Master's degree in a closely related field preferred.
• Bachelor's degree with program evaluation, quality improvement, research, or federal grant experience preferred.
• Minimum of three (3) years of experience in program evaluation or related fields.
• Experience with SAMHSA, HHS, HRSA, CDC, DOJ or other federally funded grants preferred.
• Must pass pre-employment and random drug testing and background checks.

Responsibilities

• Develop and oversee the project's evaluation plan.
• Design data collection systems for accurate, timely reporting.
• Analyze and report project performance measures, outcomes, and referral data.
• Monitor progress toward grant goals and performance indicators.
• Lead CQI activities to identify trends and improvement opportunities.
• Coordinate SAMHSA reporting and participate in cross-site evaluations as required.
• Prepare monthly, quarterly, and final evaluation reports for leadership and funders.
• Develop dashboards and data reports to support decision-making.
• Ensure confidentiality and data integrity in line with HIPAA and tribal policies.
• Collaborate with Program Manager, staff, partners, schools, and healthcare entities to improve outcomes.

Skills

Analytical skills

CQI knowledge

SAMHSA reporting

Excel proficiency

Written communication

Team collaboration

Data analysis

HIPAA compliance

Project management

Education

Master's degree in a related field

Bachelor's degree with program evaluation or federal grant experience

Tools

Microsoft Excel

Electronic databases

Data reporting systems

Job description

Pala Band Of Mission Indians

HUMAN RESOURCES OFFICE PMB#50 35008 Pala Temecula Road Pala, CA 92059

JOB DESCRIPTION

Title: Evaluator

Department/Division: Social Services- Mobile Crisis Response Team/988

Status: Full-Time

Salary: Hourly/ DOE

Supervisor: Program Manager

Subordinates: None

POSITION SUMMARY:

Under the direction of the Program Manager, the Evaluator is responsible for planning, implementing, and overseeing all evaluation, performance measurement, data collection, continuous quality improvement (CQI), and reporting activities for the Tribal 988 Project. The Evaluator ensures compliance with SAMHSA evaluation requirements by monitoring project performance, collecting and analyzing data, evaluating participant and program outcomes, measuring referral effectiveness, and preparing required federal, Tribal, and grant reports. The Evaluator works collaboratively with project staff and community partners to strengthen program effectiveness, improve service delivery, support data-driven decision-making, and ensure successful implementation of project goals and objectives.

JOB DUTIES AND RESPONSIBILITIES:

• Develop, implement, and oversee the project's evaluation and performance measurement plan.
• Design and maintain data collection systems to ensure accurate and timely reporting.
• Collect, analyze, interpret, and report project performance measures, participant outcomes, referral outcomes, and Tribal 988 utilization data.
• Monitor project implementation and evaluate progress toward grant goals, objectives, and performance indicators.
• Lead Continuous Quality Improvement (CQI) activities by identifying trends, service gaps, and opportunities for program improvement.
• Coordinate all required SAMHSA performance reporting and participate in national cross-site evaluation activities as required.
• Prepare monthly, quarterly, annual, and final evaluation reports for Tribal leadership and funding agencies.
• Develop dashboards, performance summaries, and data reports to support project management and decision-making.
• Evaluate behavioral health service utilization, referral pathways, warm handoffs, continuity of care, workforce development activities, and partnership effectiveness.
• Conduct quality assurance reviews of program documentation, reporting processes, and data integrity.
• Collaborate with the Program Manager, Project Director, behavioral health staff, community partners, schools, healthcare organizations, first responders, and California 988 partners to improve project outcomes and service delivery.
• Provide technical assistance and training to project staff regarding data collection, documentation standards, and evaluation procedures.
• Participate in grant monitoring visits, audits, technical assistance meetings, and evaluation activities.
• Present evaluation findings and recommendations to project leadership, Tribal administration, and community partners.
• Maintain confidentiality of participant and program information in accordance with HIPAA, Tribal policies, and federal regulations.
• Perform other duties as assigned by the Program Manager.

KNOWLEDGE, SKILLS, CERTIFICATIONS AND ABILITIES:

• Knowledge of program evaluation methodologies, research principles, and Continuous Quality Improvement (CQI).
• Knowledge of SAMHSA performance measures, federal reporting requirements, and behavioral health program evaluation.
• Strong analytical, organizational, and problem-solving skills.
• Ability to collect, analyze, interpret, and present quantitative and qualitative data.
• Experience preparing evaluation reports, performance summaries, and outcome analyses.
• Strong written, verbal, and presentation skills.
• Proficiency with Microsoft Office Suite, Excel, databases, and electronic data management systems.
• Ability to work collaboratively with multidisciplinary teams and community partners.
• Ability to manage multiple projects while meeting reporting deadlines.
• Ability to maintain strict confidentiality and exercise sound professional judgment.
• Endorsement and support of Tribal values, culture, and philosophy.

MINIMUM QUALIFICATIONS:

• Master's Degree in Public Health, Psychology, Social Work, Sociology, Public Administration, Statistics, Research, Evaluation, Epidemiology, or a closely related field preferred.
• Bachelor's Degree in a related field with program evaluation, quality improvement, research, or federal grant experience preferred.
• An equivalent combination of education, training, and progressively responsible experience in program evaluation, behavioral health, public health, research, quality improvement, data analysis, or federal grant management may be substituted for the educational requirements on a year-for-year basis.
• Minimum of three (3) years of experience in program evaluation, research, quality improvement, data analysis, or federal grant evaluation.
• Experience evaluating behavioral health, public health, healthcare, social services, or Tribal programs preferred.
• Experience with SAMHSA, HHS, HRSA, CDC, DOJ, or other federally funded grant programs preferred.
• Experience with data collection systems, performance measurement, continuous quality improvement (CQI), and federal reporting requirements preferred.
• Proficiency in Microsoft Office Suite, particularly Excel, and experience with electronic databases and reporting systems preferred.
• Must successfully pass pre-employment and random drug testing during employment.
• Must acknowledge and agree to maintain a drug-free workplace (including marijuana).
• Must successfully pass a background investigation.
• Must acknowledge and agree to maintain a Drug-Free workplace as a condition of employment with the Pala Band of Mission Indians. Must pass pre-employment and random drug testing during employment. A DMV print out and background check will be required.
• Must successfully pass a Fingerprint-based background check of potential employees, volunteers, and contractors pursuant to Public Law 101-630 - Indian Child Protection and Family Violence Prevention Act
• Must possess a valid California Driver's License and maintain a clean driving record.
• Indian Preference will apply in accordance with the Pala Band of Mission Indians Employment Preference Policy.

OTHER REQUIREMENTS:

All employees are expected to follow the Tribal Employee Handbook of the Pala Band of Mission Indians and must adhere to any additional applicable addendums.