17-Aug-2022 - Forschungszentrum Jülich GmbH

Synapses as a model: solid-state memory in neuromorphic circuits

Scientists at Forschungszentrum Jülich publish guide for memristor hardware design

They are many times faster than flash memory and require significantly less energy: memristive memory cells could revolutionize the energy efficiency of neuromorphic computers. In these computers, which are modeled on the way the human brain works, memristive cells function like artificial synapses. Numerous groups around the world are working on the use of corresponding neuromorphic circuits - but often with a lack of understanding of how they work and with faulty models. Jülich researchers have now summarized the physical principles and models in a comprehensive review article in the journal Advances in Physics.

Certain tasks - such as recognizing patterns and language - are performed highly efficiently by a human brain, requiring only about one ten-thousandth of the energy of a conventional, so-called "von Neumann" computer. One of the reasons lies in the structural differences: In a von Neumann architecture, there is a clear separation between memory and processor, which requires constant moving of large amounts of data. This is time and energy consuming - the so-called von Neumann bottleneck. In the brain, the computational operation takes place directly in the data memory and the biological synapses perform the tasks of memory and processor at the same time.

In Jülich, scientists have been working for more than 15 years on special data storage devices and components that can have similar properties to the synapses in the human brain. So-called memristive memory devices, also known as memristors, are considered to be extremely fast, energy-saving and can be miniaturized very well down to the nanometer range. The functioning of memristive cells is based on a very special effect: Their electrical resistance is not constant, but can be changed and reset again by applying an external voltage, theoretically continuously. The change in resistance is controlled by the movement of oxygen ions. If these move out of the semiconducting metal oxide layer, the material becomes more conductive and the electrical resistance drops. This change in resistance can be used to store information.

The processes that can occur in cells are very complex and vary depending on the material system. Three researchers from the Jülich Peter Grünberg Institute - Prof. Regina Dittmann, Dr. Stephan Menzel, and Prof. Rainer Waser - have therefore compiled their research results in a detailed review article, "Nanoionic memristive phenomena in metal oxides: the valence change mechanism". They explain in detail the various physical and chemical effects in memristors and shed light on the influence of these effects on the switching properties of memristive cells and their reliability.

"If you look at current research activities in the field of neuromorphic memristor circuits, they are often based on empirical approaches to material optimization," said Rainer Waser, director at the Peter Grünberg Institute. "Our goal with our review article is to give researchers something to work with in order to enable insight-driven material optimization." The team of authors worked on the approximately 200-page article for ten years and naturally had to keep incorporating advances in knowledge.

"The analogous functioning of memristive cells required for their use as artificial synapses is not the normal case. Usually, there are sudden jumps in resistance, generated by the mutual amplification of ionic motion and Joule heat," explains Regina Dittmann of the Peter Grünberg Institute. "In our review article, we provide researchers with the necessary understanding of how to change the dynamics of the cells to enable an analog operating mode."

"You see time and again that groups simulate their memristor circuits with models that don't take into account high dynamics of the cells at all. These circuits will never work." said Stephan Menzel, who leads modeling activities at the Peter Grünberg Institute and has developed powerful compact models that are now in the public domain. "In our review article, we provide the basics that are extremely helpful for a correct use of our compact models."

Roadmap neuromorphic computing

The "Roadmap of Neuromorphic Computing and Engineering", which was published in May 2022, shows how neuromorphic computing can help to reduce the enormous energy consumption of IT globally. In it, researchers from the Peter Grünberg Institute (PGI-7), together with leading experts in the field, have compiled the various technological possibilities, computational approaches, learning algorithms and fields of application.

According to the study, applications in the field of artificial intelligence, such as pattern recognition or speech recognition, are likely to benefit in a special way from the use of neuromorphic hardware. This is because they are based - much more so than classical numerical computing operations - on the shifting of large amounts of data. Memristive cells make it possible to process these gigantic data sets directly in memory without transporting them back and forth between processor and memory. This could reduce the energy efficiency of artificial neural networks by orders of magnitude.

Memristive cells can also be interconnected to form high-density matrices that enable neural networks to learn locally. This so-called edge computing thus shifts computations from the data center to the factory floor, the vehicle, or the home of people in need of care. Thus, monitoring and controlling processes or initiating rescue measures can be done without sending data via a cloud. "This achieves two things at the same time: you save energy, and at the same time, personal data and data relevant to security remain on site," says Prof. Dittmann, who played a key role in creating the roadmap as editor.

Facts, background information, dossiers

  • memristive memory cells
  • memory cells
  • Computers
  • memristors

More about Forschungszentrum Jülich

  • News

    A New Tool for Cryo-Electron Microscopy

    Researchers at Forschungszentrum Jülich and Heinrich Heine University Düsseldorf led by Prof. Dr. Carsten Sachse are using cryo-electron microscopy, or cryo-EM for short, to make biomolecules visible at the atomic level. In a paper now published in the journal Nature Methods, they present a ... more

    Alzheimer’s Research: New Insights into the Formation of Toxic Protein Clumps

    Small aggregates of proteins known as Aβ oligomers are suspected as the main cause for the development of Alzheimer’s disease. However, it is not yet clear where and under what conditions these toxic aggregates form. Researchers from Heinrich Heine University Düsseldorf and Forschungszentru ... more

    Increasing the Activity of Catalysts

    A layer as thin as a single atom makes a huge difference: On the surface of an electrode, it doubles the amount of water split in an electrolysis system without increasing the energy requirements. Thus, the ultrathin layer also doubles the amount of hydrogen produced without increasing cost ... more

  • q&more articles

    Macromolecular environments influence proteins

    The high-intensity interaction of proteins with other macromolecules can cause signifi cant changes to protein properties such as translational mobility, for example, or their conformational states. Accordingly, the study of proteins in macromolecular environments that typically very closel ... more

    Caffeine Kick

    Caffeine is the most widely consumed psychoactive substance worldwide. It supplies the active ingredient in beverages such as coffee, tea and energy drinks. Caffeine can focus vigilance and attention, reduce drowsiness and enhance the ability to perform cognitive functions. Its neurobiologi ... more

  • Authors

    Prof. Dr. Jörg Fitter

    Jörg Fitter studied physics at the University of Hamburg. After completing his doctoral studies at FU Berlin, he worked in neutron scattering and molecular biophysics at the Hahn Meitner Institute in Berlin and Jülich Research Center. He completed his habilitation in physical biology at Hei ... more

    Dr. David Elmenhorst

    studied medicine in Aachen before receiving his doctorate in sleep research from the German Aerospace Centre (Deutsches Zentrum für Luft- und Raumfahrt, DLR) in Cologne. During 2008/2009, he was a visiting researcher at the Brain Imaging Centre in Canada’s Montreal Neurological Institute an ... more

    Prof. Dr. Andreas Bauer

    studied medicine and philosophy in Aachen, Cologne and Düsseldorf, where he received his doctorate in the field of neuroreceptor autoradiography. After specialist medical training at Cologne University Hospital he completed his habilitation in neurology at the University of Düsseldorf. Sinc ... more

q&more – the networking platform for quality excellence in lab and process

The q&more concept is to increase the visibility of recent research and innovative solutions, and support the exchange of knowledge. In the broad spectrum of subjects covered, the focus is on achieving maximum quality in highly innovative sectors. As a modern knowledge platform, q&more offers market participants one-of-a-kind networking opportunities. Cutting-edge research is presented by authors of international repute. Attractively presented in a high-quality context, and published in German and English, the original articles introduce new concepts and highlight unconventional solution strategies.

> more about q&more

q&more is supported by: