Psych Assessment Love

Refers to the consistency of scores obtained by the same persons when they are reexamined by the same test on different occassions.

Variance from true differences.

Variance from irrelevant, random sources.

Ratio of true score variance and the total variance.

The most common way of computing a correlation.

Expresses the degree of correspondence or a relationship between two sets of scores.

Sources of error variance:

Reliability estimates:

Estimate of reliability obtained by correlating pairs of scores from the same people on two different administrations of the same test.

If interval of test retest administration is more than 6 months.

Estimate of the extent to which item sampling and other errors have affected scores on versions of the same test.

Independently constructed test designed to meet same specifications.

The degree of relationship between various forms of a test.

Is obtained by correlating two pairs of scores obtained from equivalent halves of a single test administered once.

Other term for split half reliability

Estimates the effect of lengthening and shortening of a test.

Two sources of error variance that influence inter item consistency:

The most common formula for finding inter item consistency.

Is the mean of all split half coefficients from different splitting of the test.

Is applicable to tests whose items are scored as right or wrong, or according to some other all-or-none systems.

A generalized formula for tests that have multiple-scored items.

Degree of agreement or consistency between two or more scorers with regards to a particular measure.

Index of measurement for interscorer reliability

Errors due to examiner bias:

Less than accurate rating or evaluation by a rater or judge due that rater's tendency to make ratings near the midpoint of the scale.

Rater's tendency to be too forgiving or insufficiently critical.

Rater's tendency to be overly critical.

Tendency of the leader to judge all aspects of an individual using a general impression that was formed on only one or few of the individual's characteristics .

Refers to the tendency to let one poor rating influence all other ratings, resulting in a lower overall evaluation than deserved.

Happens when raters compares examinees with one another instead of against performance standards.

Occurs when leader assigns ratings based only on the employee's most recent performance.

This measure is suited to the interpretation of individual scores. Is independent of the variability of the group on which it is computed.

Is an estimate of how well a test measures what it purports to measure.

3 categories of validity:

Two major trends in validity:

Evaluation of subjects, topics, or contenys in a test.

Evaluation of the relationship of scores to scores on other tests or instruments.

Comprehensive analysis of theoretical framework+scores on other tests.

Describes a judgement of how adequately a test samples behavior representative of the universe of behavior that the test is designed to sample.

Judgment of how a test score can be used to infer an individual's most probable standing based on some measure of interest.

May be broadly defined as the standard against whichba test or a test score is evaluated.

Criterion has to be:

Error where ratings become influenced based on rater's knowledge of test scores.

2 types of criterion-related validity:

The extent scores on a new measure relate to scores from a criterion measure administered at the same time.

Uses the scores from the new measure to predict performance on a criterion measure administered at a later time.

A correlation coefficient that provides a measure of the relationship between test scores and scores on the criterion measure.

Judgment about the appropriateness of inferences drawn from test scores regarding individual standings on a variable called construct.

He pointed out that in order to demonstrate construct validity, a test must correlate highly with variables it should theoretically correlate, and vice versa.

High relationship with measures construct is supposed to be related to.

Low relationship with measures construct is not supposed to be related to.