1. What are the contributions in "Understanding public evaluation: quantifying experimenter intervention" ?
” Different approaches place experimenters in different roles during deployment, which has implications for the kinds of data that can be collected and the potential bias introduced by the experimenter.. This paper expands their understanding of how experimenter roles impact public evaluations and provides an empirical basis to consider different evaluation approaches.
read more
2. What future works have the authors mentioned in the paper "Understanding public evaluation: quantifying experimenter intervention" ?
These results provide an empirical baseline that captures the most common approaches, but further conditions could expand this framework.. Further research exploring non-interactive displays, non-functioning displays, and more complex displays would significantly expand their understanding of observer effects in a wider range of scenarios.. The significance and magnitude of the observer effects seen even in this simple and playful installation suggest that observation must be very carefully considered in public evaluation.. In their stewarded condition, the refusal of consent by passers-by and potential discomfort of apparently consenting participants raises ethical questions.
read more
![Figure 5. Baseline pedestrian motion in the space used for evaluation. Each blue line represents the motion of one pedestrian through the space [extracted automatically from video]. Top: Low traffic baseline, N=1993, Bottom: High traffic baseline, N=4817. Pedestrian routes are similar in both high and low traffic days.](/figures/figure-5-baseline-pedestrian-motion-in-the-space-used-for-g1trd9wm.webp)
![Figure 6. Pedestrian traffic for three evaluation conditions. Each blue line represents the motion of one pedestrian through the space [extracted automatically from video]. Top: Steward Observer, N= 1634, Middle: Overt Observer, N=1769, Bottom: Covert Observer, N=2000.](/figures/figure-6-pedestrian-traffic-for-three-evaluation-conditions-p8abt7ea.webp)
