 |
| 1 | |
Which of the following statements most likely involves using data in a way that is not valid? |
| | A) | University data indicate that the highest paid professors have the most publications. |
| | B) | Students who can type more than 80 words per minute will receive a typing award. |
| | C) | All of the teachers interviewed described the principal as "outstanding." |
| | D) | A teacher uses self evaluations to grade writing ability |
|
|
|
| 2 | |
Which of the following is content-related evidence of validity? |
| | A) | Test items are at an appropriate reading level. |
| | B) | Observed participant characteristics are consistent with responses on a scale. |
| | C) | Scores obtained on two administrations of the instrument are consistent. |
| | D) | Scores are correlated with scores obtained on another instrument. |
|
|
|
| 3 | |
The best construct-related evidence of validity comes from |
| | A) | a series of studies of the instrument. |
| | B) | a validity coefficient that is near 0. |
| | C) | careful review of the instrument by experts. |
| | D) | data-based predictions that prove to be correct. |
|
|
|
| 4 | |
Which of the following statements accurately portrays the relationship of reliability to validity? |
| | A) | Inferences must be valid before the scores can be reliable. |
| | B) | Scores must be reliable before inferences can be valid. |
| | C) | The more valid the inference is, the higher the reliability of the score must be. |
| | D) | Score reliability is not related to inference validity. |
|
|
|
| 5 | |
Which of the following is most likely to be the alternate forms reliability coefficient for a well-established standardized test? |
| | A) | -0.93 |
| | B) | +0.46 |
| | C) | +0.89 |
| | D) | +1.42 |
|
|
|
| 6 | |
Measurement error cannot be assessed by |
| | A) | giving the instrument to the same group twice |
| | B) | comparing scores on different parts of the instrument |
| | C) | giving the instrument to two different groups |
| | D) | giving two forms of the instrument to the same group |
|
|
|
| 7 | |
An expectancy table is shown below.
| Observer's behavior rating | Disciplinary Action is Taken | | Often | Sometimes | Never | | Excellent | 6 | 4 | A | | Typical | 13 | B | 11 | | Problem | C | 7 | 2 |
What numbers put in place of "A," "B," and "C" would provide the best criterion-related evidence of validity? |
| | A) | A = 62, B = 2, C = 8 |
| | B) | A = 71, B = 38, C = 49 |
| | C) | A = 4, B = 3, C = 8 |
| | D) | A = 1, B = 6, C = 51 |
|
|
|
| 8 | |
What are the two forms of criterion-related validity? |
| | A) | correlational and content |
| | B) | predictive and correlational |
| | C) | predictive and concurrent |
| | D) | criterion and predictive |
|
|
|
| 9 | |
To obtain evidence of predictive validity a researcher will have to |
| | A) | consult another researcher. |
| | B) | review all of the instruments. |
| | C) | gather instrument data and criterion data at nearly the same time. |
| | D) | allow a time interval to elapse between administration of the instrument and obtaining the criterion scores. |
|
|
|
| 10 | |
A researcher administers a history aptitude test to a group of middle school students and later compares their test scores with their end-of-the-semester grade in history. This is an example of obtaining evidence of |
| | A) | predictive validity. |
| | B) | concurrent validity. |
| | C) | content related evidence of validity. |
|
|
|
| 11 | |
Which of the following is not one of the three best-known ways to obtain a reliability coefficient? |
| | A) | test-retest |
| | B) | equivalent forms |
| | C) | internal consistency |
| | D) | concurrent |
|
|
|
| 12 | |
Which of the following are the three best known ways to obtain a reliability coefficient? |
| | A) | predictive, concurrent, and equivalent forms |
| | B) | test-retest, equivalent forms, and internal consistency |
| | C) | test-retest, concurrent, and equivalent forms |
|
|
|
| 13 | |
To obtain evidence of concurrent validity a researcher will have to |
| | A) | consult another researcher. |
| | B) | review all of the instruments. |
| | C) | gather instrument data and criterion data at nearly the same time. |
| | D) | allow a time interval to elapse between administration of the instrument and obtaining the criterion scores. |
|
|
|
| 14 | |
If a researcher wishes to obtain content-related evidence of validity, a common way to do this is to |
| | A) | have a friend look over the instrument and give feedback. |
| | B) | obtain a Kuder-Richardson analysis. |
| | C) | review the instrument very carefully. |
| | D) | have an individual who knows enough about what is to be measured review the content and format of the instrument and judge whether it is appropriate. |
|
|
|
| 15 | |
What are the three main types of evidence on validity that a researcher might collect? |
| | A) | content-related, criterion-related on, construct-related |
| | B) | historical, criterion-related |
| | C) | content-related, laboratory, construct-related |
| | D) | content-related, criterion-related, observation-related |
|
|
.