Gail Jones: Research and Evaluation
Models of Evaluation
Systems analysis (cost-benefit analysis)
- Are the expected outcomes achieved?
- Can the effects be achieved more economically?
- What are the most efficient programs?
- Is it being implemented the way it was designed?
- How much does it cost?
- What are its costs relative to its effectiveness?
Objective or goals based (productivity and accountability)
- Are the objectives being met?
- Is the program producing?
Decision-making (effectiveness and quality control: context, input, process, product)
- Is it effective?
- What parts are effective?
Goal free (consumer choice and social utility)
Art criticism (heightened awareness and improved standards)
- "Criticism is the art of disclosing the qualities of events or objects that connoisseurship perceives" (Eisner, 1979)
- would a critic approve of this program?
- is the audience's appreciation increased?
Case study (understanding and diversity)
- what does the program or product look like to different people?
- how and why does the individual use this product?
Potential Evaluation Studies
- Individual interviews
- Focus group interviews
- Surveys
- Card sorting tasks
- Concept maps
- Performance tasks
- Authentic assessments
Considerations
- Validity (something outside the mind that's verifiable through public agreement)
- Objectivity (factual, not subjective or biased)
- Impartiality
- Evaluation vs. research