Long time coming. A very cool project that showcases the advantages of single neuron adaptation in RNNs.
#PLOSCompBio: Neural networks with optimized single-neuron adaptation uncover biologically plausible regulari ...
dx.plos.org/10.1371/jour...
Props to V. Geadah and co-authors!

Neural networks with optimized single-neuron adaptation uncover biologically plausible regularization
Author summary Evolution has shaped neural circuits in the brain to support complex tasks and behavior. In doing so, single neurons have developed intriguing coding properties such as heterogeneous an...