Blind trust in enhancement technologies encourages risk-taking even if the tech is a sham

A new study suggests that a placebo effect is at play when people expect their performance to be enhanced by augmentation technologies, such as artificial intelligence (AI). The researchers found that individuals with high expectations of these technologies engage in riskier decision-making, which could be a problem as people adopt these technologies without properly understanding their benefits and limits.

Augmentation technologies boosting our physical, cognitive, or sensory performance have become commonplace. Some are so widely in use that they’ve become invisible – spellcheck, for example – and new technologies are emerging that could push our abilities beyond human limits, like exoskeletons and AI-based vision-enhancement. But the hype around these technologies also builds expectations, which could lead people to change their behaviour.

‘Individuals are more inclined to take risks when they believe they are enhanced by cutting-edge technologies like AI or brain-computer interfaces,’ says Robin Welsch, assistant professor at Aalto University. ‘This occurs even if no actual enhancement technology is involved, indicating that it’s about people’s expectations rather than any noticeable improvement. The findings also imply that a strong belief in improvement, based on a fake system, can alter decision-making.’

Don’t trust the processor

Together with colleagues at LMU Munich, HU Berlin and Aalto University, Welsch measured decision-making and risk-taking behaviour with a well-known psychological experiment, the Columbia Card Task. In the experiment, participants win or lose points by turning over cards with hidden values. The 27 participants were led to believe that an AI-controlled brain-computer interface, the placebo, would enhance their cognitive abilities by using binaural sounds to track the loss cards.

But the game was rigged – the augmentation provided no real benefit, and participants almost never encountered a loss card. Still, most of the participants thought the augmentation had helped them do better, and this made them take on greater risks. These findings show how sham cognitive enhancements can have real effects on risk-taking.

‘The hype surrounding these technologies skews people’s expectations,’ says Steeven Villa, doctoral researcher at LMU Munich. ‘It can lead people to make riskier decisions and favourable user evaluations, which can have real consequences.’

Technology is never neutral

Modern AI-based vision enhancement tools are becoming available for firefighters to see through smoke, and factory workers are already taking advantage of exoskeletons to handle loads that defy human physique. The creeping effects of generative AI systems could offer similar boosts to knowledge workers. The authors are worried that entire professions could develop a larger appetite for risks, built on misguided expectations.

‘AI-based technologies that enhance users are increasingly common and play a role in real-life decisions that impact people’s lives, well-being, confidence, and safety.’ says Thomas Kosch, professor at HU Berlin. ‘To ensure the effectiveness of new technologies beyond the hype, placebo-controlled studies are necessary for accurate evaluation and validation to tell apart snake-oil from real innovation.’