Why Spiking Neural Networks Need a Little Randomness to Learn
Source PublicationNanoscale Horizons
Primary AuthorsJang, Lee, Shin et al.
"A postal sorting office where parcels arriving at perfectly regular intervals cause workers to zone out, whereas slightly random delays keep them alert and accurate."

Imagine a busy sorting office for the postal service. If parcels roll down the conveyor belt at exactly the same speed, second after second, the workers autumn into a hypnotic rhythm. They stop paying attention. They might even miss important details, sending letters to the wrong addresses. But if those parcels arrive with slight, unpredictable pauses, the workers are forced to stay alert. They cannot zone out. They check each label carefully, and the entire system works better because of that tiny bit of chaos.
This same idea applies to the newest forms of artificial intelligence.
Why Spiking Neural Networks Need Randomness
Scientists are building computer chips that mimic the human brain. These systems, called spiking neural networks, do not process information in a constant, heavy stream like a standard laptop. Instead, they communicate using quick flashes of electricity, or spikes. This method saves a massive amount of power.
However, these brain-like computers have a hidden weakness. If the incoming spikes are too steady and uniform, the computer struggles to learn. Just like the bored postal workers, the system needs a dash of randomness to figure things out and form new connections. Usually, engineers fix this by adding extra computer parts to generate random numbers. But those extra parts consume a lot of energy, which ruins the point of building a low-power chip in the first place.
Creating Delays on Purpose
To solve this problem, researchers tried a different approach. They built a tiny electrical gate that acts exactly like a slightly unpredictable conveyor belt. When a spike of electricity arrives, this gate holds onto it for a random fraction of a second before passing it along.
They made this gate using special materials called resistive random-access memory (RRAM) and threshold-switching devices. By changing the resistance in the material, they can control how long the delay lasts on average. If they increase the resistance, the delay gets longer. Importantly, the exact timing of every single delay is naturally unpredictable.
If a spike enters the gate, then it comes out slightly later, completely naturally. The engineers do not need a separate, power-hungry machine to create this randomness. The physical material does the job on its own, step by step.
A Smarter Way to Learn
The research team tested this idea by asking the system to recognise handwritten numbers. They compared their new delay method against older methods that used perfectly timed spikes, as well as systems that used bulky random number generators.
The results were clear. The system with the built-in random delays learned more accurately than the steady baseline. The physical delay provided just the right amount of unpredictability to keep the artificial brain sharp and focused.
This suggests that future computers could be both highly intelligent and incredibly energy efficient. By simply letting physical materials act a little unpredictably, we may build machines that learn much like we do.