|
"Be it further resolved that this period of testing include a systematic and widespread gathering of appropriate feedback from faculty and students concerning the content and form of proposed core items"
|
1. Use the proposed set of seven core items and invite faculty and students to provide additional suggestions and feedback as items are used.
2. Alvin Alvarez, Assistant Professor of Counseling and member of the Faculty Affairs Committee, will serve as the Academic Senate liaison to the project. Other faculty members will be called upon to serve on a panel of experts and to consult as needed on various aspects of the project.
3. Warren, Vaughn, Chaney and Verhey to present interactive program on teaching effectiveness at Asilomar 2001.
4. See 2.A. below. The web page will also provide for quantitative feedback from participants.
5. Periodic reports on project progress will be made to the Academic Senate.
|
|
"Be it further resolved that any implementation of a campus-wide program be preceded by a systematic evaluation of the construct validity, the content validity and reliability of these (and/or revised) items, and
Be it further resolved that there be at least one full calendar year of testing and analyses of feedback from faculty and students, and
Be it further resolved that the final set of items submitted to the Senate should have demonstrated construct and content validity, and reliability"
|
Conduct reliability and validity studies on proposed set of locally developed items. See Attachment A for definitions and strategies for reliability and validity testing. A power analysis will be conducted to determine appropriate sample size. The items will be used in an appropriate number of classes during the Spring 2001, Summer 2001 and Fall 2001 terms. A uniform set of instructions for classroom item administration will be developed.
1. Reliability: Cronbach's alpha
2. Construct Validity:
- The 15 common criteria identified in the Senate Task Force report will be used to develop a web-based "ballot" to determine those criteria valued most highly by SFSU faculty and students, results to be compared against proposed set of core items.
- Factor analysis
3. Content Validity:
- Hambleton Method using a panel of experts representing all colleges.
- Conduct item comparison analysis using four standardized national instruments with extensive validity and reliability testing already conducted. See Attachment B for list of instruments.
- Colleges may volunteer to submit anonymous, aggregated data on similarly worded items from existing college instruments for comparison purposes.
4. Adopt standardized set of items.
|