‘Spidey senses’ could help autonomous machines see better

WEST LAFAYETTE, Ind. — What if drones and self-driving cars had the tingling “spidey senses” of Spider-Man?

They might actually detect and avoid objects better, says Andres Arrieta, an assistant professor of mechanical engineering at Purdue University, because they would process sensory information faster.

Better sensing capabilities would make it possible for drones to navigate in dangerous environments and for cars to prevent accidents caused by human error. Current state-of-the-art sensor technology doesn’t process data fast enough – but nature does.

And researchers wouldn’t have to create a radioactive spider to give autonomous machines superhero sensing abilities.

Instead, Purdue researchers have built sensors inspired by spiders, bats, birds and other animals, whose actual spidey senses are nerve endings linked to special neurons called mechanoreceptors.

The nerve endings – mechanosensors – only detect and process information essential to an animal’s survival. They come in the form of hair, cilia or feathers.

“There is already an explosion of data that intelligent systems can collect – and this rate is increasing faster than what conventional computing would be able to process,” said Arrieta, whose lab applies principles of nature to the design of structures, ranging from robots to aircraft wings.

“Nature doesn’t have to collect every piece of data; it filters out what it needs,” he said.

Many biological mechanosensors filter data – the information they receive from an environment – according to a threshold, such as changes in pressure or temperature.

A spider’s hairy mechanosensors, for example, are located on its legs. When a spider’s web vibrates at a frequency associated with prey or a mate, the mechanosensors detect it, generating a reflex in the spider that then reacts very quickly. The mechanosensors wouldn’t detect a lower frequency, such as that of dust on the web, because it’s unimportant to the spider’s survival.

The idea would be to integrate similar sensors straight into the shell of an autonomous machine, such as an airplane wing or the body of a car. The researchers demonstrated in a paper published in ACS Nano that engineered mechanosensors inspired by the hairs of spiders could be customized to detect predetermined forces. In real life, these forces would be associated with a certain object that an autonomous machine needs to avoid.

But the sensors they developed don’t just sense and filter at a very fast rate – they also compute, and without needing a power supply.

“There’s no distinction between hardware and software in nature; it’s all interconnected,” Arrieta said. “A sensor is meant to interpret data, as well as collect and filter it.”

In nature, once a particular level of force activates the mechanoreceptors associated with the hairy mechanosensor, these mechanoreceptors compute information by switching from one state to another.

Purdue researchers, in collaboration with Nanyang Technology University in Singapore and ETH Zürich, designed their sensors to do the same, and to use these on/off states to interpret signals. An intelligent machine would then react according to what these sensors compute.

These artificial mechanosensors are capable of sensing, filtering and computing very quickly because they are stiff, Arrieta said. The sensor material is designed to rapidly change shape when activated by an external force. Changing shape makes conductive particles within the material move closer to each other, which then allows electricity to flow through the sensor and carry a signal. This signal informs how the autonomous system should respond.

“With the help of machine learning algorithms, we could train these sensors to function autonomously with minimum energy consumption,” Arrieta said. “There are also no barriers to manufacturing these sensors to be in a variety of sizes.”

This work is financially supported by ETH Zürich and Purdue University, and aligns with Purdue’s Giant Leaps celebration, acknowledging the university’s global advancements made in AI, algorithms and automation as part of Purdue’s 150th anniversary. This is one of the four themes of the yearlong celebration’s Ideas Festival, designed to showcase Purdue as an intellectual center solving real-world issues.

###

ABSTRACT

Filtered Mechanosensing Using Snapping Composites with Embedded Mechano-Electrical Transduction

Hortense Le Ferrand^1,2,3, Andre R. Studart², Andres F. Arrieta¹

1 Purdue University, West Lafayette, IN, USA

2 ETH Zürich, Zürich, Switzerland

3 Nanyang Technological University, Singapore

doi: 10.1021/acsnano.9b01095

Mechanosensing is ubiquitous in natural systems. From the skin ridges of our finger tips to the microscopic ion channels in cells, mechanosensors allow organisms to probe their environment and gather information needed for processing, decision making, and actuation. Despite technological advances in synthetic mechanosensing, it remains challenging to achieve this functionality at the scale of large stiff structures where both the amount of data to sense locally and the diversity of input stresses that the sensors have to withstand require highly tunable systems. Filtered sensing using mechanical displacement is an effective strategy developed by organisms to cope with large sets of stimuli. Inspired by this biological strategy, we fabricate bistable elements that can passively filter mechanical inputs, translate them into electrical signals, and be reset to their original sensing state using an external magnetic field. These multiple functionalities are achieved using hierarchically structured composites that can be arranged in large-area arrays. The filtering capability and fast passive response of our mechanosensors are experimentally demonstrated using simple electrical circuits and magnets. Thanks to their scalability and applicability to a wide range of material systems, these low-power sensors are avenues for the fabrication of load-bearing structures that are able to sense, compute, communicate, and autonomously adapt in response to external magneto-mechanical stimuli.