This assignment is divided into two parts. The first part involves evaluating the reliability and validity of the Teacher Evaluation Experience Scale-Teacher Form (TEES-T). The second part involves evaluating the reliability and validity of a qualitative study.
Part 1: Instructions
As a critical consumer of science, it is a good idea to examine and critically evaluate the psychometric evidence (i.e., reliability and validity) for measures that you are both familiar and not with. Thus, in Part 1 of this assignment you will read a psychometrically focused article on Measuring Educators’ Attitudes and Beliefs About Evaluation Download Measuring Educators’ Attitudes and Beliefs About Evaluationfor a newly developed measure and evaluate the reliability and validity evidence for this measure. Then, you will be asked to submit your answers to 10 multiple choice and short answer questions. You can preview the question here Download here.
Issues to keep in mind while reading the article:
- If a measure is not reliable, it cannot be valid.
- Validity evidence is accumulated—there is no single test that can be conducted to definitively establish the validity of a measure. Thus, you have to make a reasoned decision if the pattern of associations of the TEES-T with other measures supports the validity of the TEES-T.
Now that you’ve evaluated the reliability and validity of the Teacher Evaluation Experience Scale-Teacher Form (TEES-T) Download Teacher Evaluation Experience Scale-Teacher Form (TEES-T), it’s time to evaluate the reliability and validity in a qualitative article.
For part 2 of the assignment, review the following article:
- Yuknis, C. (2014). A grounded theory of text revision processes used by young adolescents who are deaf. Exceptional Children, 80(3), 307-322.
Using only this article, look for indicators of reliability and validity. On the quiz, you will be asked 13 true/false questions on the 13 indicators listed below. Review the article and determine your answers before starting the quiz because you will need to complete the quiz in one sitting. You will only be allowed one attempt on this assignment.
Reliability
Listed below are three methods for maintaining reliability. Identify which of these the professor provided direct evidence of using:
- Data check
- Cross-checks
- External audit
External Validity
Identify if there is any information given by the researcher on each of the following:
- The person
- The place or site they are studying
- The time they invest in data collecting
- The length of time of the study
- The particular context and culture of the study (situate the study)
Internal Validity
Identify which methods were used by the researcher to protect against threats to internal validity:
- Triangulation
- Prolonged engagement
- Member checks/peer debriefing
- Constant comparative
- Deviant case analysis
Guidelines
- Review the linked Yuknis article for the indicators of reliability and validity listed on this page
- Take the quiz and answer the true/false questions on each indicator