From Evaluation to Expansion: Enhancing Skills in the Pacific Islands
The International Skills Training (IST) Courses Programme was crafted to bridge competency gaps and meet global workforce demands. Implemented in Fiji, Samoa, Tonga, and Vanuatu from 2017 to mid-2019, this Australian-funded programme was evaluated to assess its impact on shifting towards competency-based training in the Pacific and to offer insights for enhanced outcomes.
Evaluation Approach
Dr Fiona Kotjovs led the evaluation, crafting key questions and a programme logic. She formulated and executed an Evaluation Plan in Fiji, applying Kirkpatrick’s four-level model, contribution analysis, a utilisation-focused approach, and both case study and cross-case analysis. This strategy was designed to cater to the diverse educational landscapes of the four Pacific countries involved.
Implementation Strategy
The evaluation began with stakeholder consultations and document reviews to tailor the evaluation questions and programme logic. Data collection spanned over 150 interviews, including 64% of course participants, and was conducted across rural and urban areas. Independent interviews with managers, colleagues, and students were conducted to validate the participants' feedback. A participant survey achieved a high response rate, with over 70% return rates in most countries, except Vanuatu. Content analysis was used to interpret the data in line with the programme logic.
Outcomes and Benefits
The evaluation revealed significant impacts on training in the pilot countries, guiding the decision to expand the programme. Recommendations on course design, commissioning, and implementation were adopted, leading to improved training outcomes. These findings provided a strong foundation for the programme's growth and success.
Comments