Trial Outcomes & Findings for Project 3 Example: Human-AI Collaboration Tester (HAICT) Exp. 7 (NCT NCT05272189)

Project 3 Example: Human-AI Collaboration Tester (HAICT) Exp. 7

D' (d-prime) is the signal detection theory measure of the level of performance on a task. It is computed by calculating the proportion of true positive responses =(true positive trials)/(true positive + false negative trials) = p(TP) and by calculating the proportion of false positive responses =(false positive trials)/(false positive + true negative trials) = p(FP). These values are transformed into 'z-scores' (for example, using NORMSINV in Excel to calculate the inverse of the standard normal distribution). D' is defined as Z(TP)-Z(FP). Its range is from 0 for cases where no signal can be discriminated from the noise, to \~4.0. The upper limit is not defined, but 4 would mean that and observer is essentially perfect at discriminating signal from noise.

Criterion, like D' (see above) is calculated from z(TP) and z(FP). Criterion ( c ) = (z(TP)+z(FP))/-2. A value of zero means that the observer is equally likely to make a positive (e.g. 'target present') response as a negative (absent) response. Positive values mean that the observer is more likely to say "absent" (a "conservative" criterion). Negative values mean the observer is more likely to say "present" (a "liberal" criterion). Liberal and conservative have no political connotations in this case. Criterion values almost always fall between -2 and 2.

This is the measure of how long it takes to make a response.