A number of different evaluation strategies are used in evaluating the Fellowship program. Evaluation of the Fellowship is best described as consisting of two major types: 1) evaluation of Fellows' work and 2) Fellowship program evaluation. Each of these are described below.
Evaluation of Fellows
Pre/PostTests
A multiple choice test is the format for these objective measures of the cognitive information presented in the courses during the Fellowship. They are administered at the start and at the completion of each of the three Fellowship segments. Fellows' percentage gain scores are shared with each fellow and with his or her program director as well as with Fellowship instructors.
Project Evaluation
As described in the curriculum section, each Fellowship content area employs some lecture-based didactic presentations and some form of practice or application of the skills. The project/activity analysis is an instrument which FDC uses to document each Fellow's participation in and completion of these practica and projects. Examples of the activities evaluated by this method include, but are not limited to: practice teaching, curriculum project completion and presentation, research project completion and presentation, and delivering formal lectures.
Performance Feedback
Fellows' receive feedback from the FDC professional staff on all required practica and projects including lecture presentation, research projects, curriculum projects and clinical teaching skills. Both live observation and videotaping are used. Our purpose is tohelp Fellows improve their performance by highlighting both their areas of strength and weakness.
Personal Development Feedback
This feedback is provided to each Fellow by an assigned FDC advisor. One of the two professionally trained counselors on the FDC staff will meet weekly with individual Fellows to assist with the transition and integration into a faculty role. Observational data on Fellows' progress will be shared during these sessions.
Periodic Reports to Fellows' Directors
These reports are provided at the end of each of the three Fellowship segments. Instructors write performance feedback and evaluation on each Fellow, which is sent to Fellows and their program directors or chairs. The purpose of these reports is to share with Fellows' home program how the Fellow has spent his or her time while in Waco, and to help Fellows' improve their performance.
FDC Fellowship Program Evaluation
FDC has continuously refined the Fellowship program through a long standing process of evaluation. Three strategies, described below, are used to ensure that the program continues to be effective, efficient, and accessible.
Exit Interviews
The FDC Director conducts an individual interview with each fellow at the end of Segment III to ascertain Fellows' evaluation of the Fellowship as a whole. This structured, qualitative evaluation is a valuable tool for the FDC as we revise and update course offerings, teaching strategies, resources, and Fellowship logistics. Results are shared with FDC staff for program evaluation and refinement.
Participant Questionnaire
This instrument is completed by all Fellows at the completion of each of the three Fellowship segments. It is used to evaluate the content and process of the fellowship. Fellows complete an anonymous, open-ended evaluation form on each course offering presented during the month. Comments are solicited on content of the training, materials used (i.e. books, handouts), and the instruction provided. These comments are compiled and shared with individual instructors and the FDC staff.
Fellowship Alumni Survey
A full Fellowship alumni survey is conducted every three years. FDC has been providing faculty development as a regional center for over 28 years, and recognizes the importance of measuring the long-term results of the Fellowship.
