'Organismic learning' mimics some aspects of human thought

Jairui Li (Massachusetts Institute of Technology), Riccardo Comin (Massachusetts Institute of Techno enlarge

Jairui Li (Massachusetts Institute of Technology), Riccardo Comin (Massachusetts Institute of Technology), and Claudio Mazzoli of Brookhaven's NSLS-II at NSLS-II's coherent soft x-ray scattering beamline 23-ID-1. The research team used the tunable x-ray beam to scan samples prepared by Purdue University researchers so they could learn about how the material's magnetic properties relate to its ability to "learn" from interactions with the environment.

The following news release was issued today by Purdue University. Researchers from Purdue University, Rutgers University, the Massachusetts Institute of Technology, Argonne National Laboratory and Brookhaven National Laboratory studied devices called organismoids, which are made from a “quantum material” called samarium nickelate. These devices possess habitational behavior and help scientists to advance new learning algorithms that mimic some aspects of the human brain. To study the magnetic structure of these special devices, the collaboration used Brookhaven National Laboratory’s bright x-ray source, the National Synchrotron Light Source II (NSLS-II). The bright soft x-ray beam from beamline 23-ID-1 provided a well tunable tool for these challenging measurements and offered the researchers a high spatial resolution to scan their sample. To learn more about experimental opportunities and capabilities of NSLS-II, see the related links at the end of the news release. To interview Brookhaven scientists engaged in the experimental studies or involve in beamline operations, contact Ricarda Laasch, 631-344-8458, laasch@bnl.gov.

WEST LAFAYETTE, Ind. – A new computing technology called “organismoids” mimics some aspects of human thought by learning how to forget unimportant memories while retaining more vital ones.

“The human brain is capable of continuous lifelong learning,” said Kaushik Roy, Purdue University’s Edward G. Tiedemann Jr. Distinguished Professor of Electrical and Computer Engineering. “And it does this partially by forgetting some information that is not critical. I learn slowly, but I keep forgetting other things along the way, so there is a graceful degradation in my accuracy of detecting things that are old. What we are trying to do is mimic that behavior of the brain to a certain extent, to create computers that not only learn new information but to learn what to forget.”

The team is made up of researchers from Purdue, Rutgers University, the Massachusetts Institute of Technology, Brookhaven National Laboratory and Argonne National Laboratory.

Central to the research is a ceramic “quantum material” called samarium nickelate, which was used to create devices called organismoids, said Shriram Ramanathan, a Purdue professor of materials engineering.

“These devices possess certain characteristics of living beings and enable us to advance new learning algorithms that mimic some aspects of the human brain,” Roy said. “The results have far reaching implications for the fields of quantum materials as well as brain-inspired computing.”

Findings are detailed in a paper appearing on (date) in the journal Nature Communications.

When exposed to hydrogen gas the material undergoes a massive resistance change, as its crystal lattice is “doped” by hydrogen atoms. The material is said to breathe, expanding when hydrogen is added and contracting when the hydrogen is removed.

“The main thing about the material is that when this breathes in hydrogen there is a spectacular quantum mechanical effect that allows the resistance to change by orders of magnitude,” Ramanathan said. “This is very unusual, and the effect is reversible because this dopant can be weakly attached to the lattice, so if you remove the hydrogen from the environment you can change the electrical resistance.”

The research paper’s co-authors include Purdue postdoctoral research associate Fan Zuo and graduate student Priyadarshini Panda. A complete list of co-authors is available in the abstract.

When hydrogen is exposed to the material, it splits into a proton and an electron, and the electron attaches to the nickel, temporarily causing the material to become an insulator.

 “Then, when the hydrogen comes out, this material becomes conducting again,” Ramanathan said. “What we show in this paper is the extent of conduction and insulation can be very carefully tuned.”

This changing conductance and the “decay of that conductance over time” is similar to a key animal behavior called habituation.

“Many animals, even organisms that don’t have a brain, possess this fundamental survival skill,” Roy said. “And that’s why we call this organismic behavior. If I see certain information on a regular basis, I get habituated, retaining memory of it. But if I haven’t seen such information over a long time then it slowly starts decaying. So the behavior of conductance going up and down in exponential fashion can be used to create a new computing model that will incrementally learn and at same time forget things in a proper way.”

The researchers have developed a “neural learning model” they have termed adaptive synaptic plasticity.

“This could be really important because it’s one of the first examples of using quantum materials directly for solving a major problem in neural learning,” Ramanathan said.

The researchers used the organismoids to implement the new model for synaptic plasticity.

“Using this effect we are able to model something that is a real problem in neuromorphic computing,” Roy said. “For example, if I have learned your facial features I can still go out and learn someone else’s features without really forgetting yours. However, this is difficult for computing models to do. When learning your features, they can forget the features of the original person, a problem called catastrophic forgetting.”

Neuromorphic computing is not intended to replace conventional general-purpose computer hardware, based on complementary metal-oxide-semiconductor transistors, or CMOS. Instead, it is expected to work in conjunction with CMOS-based computing. Whereas CMOS technology is especially adept at performing complex mathematical computations, neuromorphic computing might be able to perform roles such as facial recognition, reasoning and human-like decision making.

Roy’s team performed the research work on the plasticity model, and other collaborators concentrated on the physics of how to explain the process of doping-driven change in conductance central to the paper.

This is a multidisciplinary team consisting of experts in materials, electrical engineering, physics, and algorithms.

“It’s not often that a materials-science person can talk to a circuits person like professor Roy and come up with something meaningful,” Ramanathan said.

Organismoids might have applications in the emerging field of spintronics. Conventional computers use the presence and absence of an electric charge to represent ones and zeroes in a binary code needed to carry out computations. Spintronics, however, uses the "spin state" of electrons to represent ones and zeros.

 It could bring circuits that resemble biological neurons and synapses in a compact design not possible with CMOS circuits. Whereas it would take many CMOS devices to mimic a neuron or synapse, it might take only a single spintronic device, possibly allowing for a compact, energy-efficient technology.

In future work, the researchers may demonstrate how to achieve habituation in an integrated circuit instead of exposing the material to hydrogen gas.

The research is affiliated with the Center for Spintronic Materials, Interfaces and Novel Architecture (C-SPIN), one of six centers funded by the Semiconductor Research Corporation and the Defense Advanced Research Projects Agency.

Funding for the research was provided by the U.S. Army Research Office, U.S. Air Force Office of Scientific Research, C-SPIN, Intel Corporation, and by the Vannevar Bush Faculty Fellowship.

Learn more about research opportunities at NSLS-II.

Visit the beamline website of 23-ID-1

Writer: Emil Venere, 765-494-4709, venere@purdue.edu

Sources: Kaushik Roy, 765 494-2361, kaushik@ecn.purdue.edu, Shriram Ramanathan, 765-496-0546, shriram@purdue.edu,

Related Web Sites:
Kaushik Roy

Financial support was provided by ARO, AFOSR, C-SPIN, one of the six centers of STARnet, a Semiconductor Research Corporation Program, sponsored by MARCO and DARPA, by the Semiconductor Research Corporation, the National Science Foundation, Intel Corporation and by the Vannevar Bush Faculty Fellowship. We acknowledge the Center of Nanoscale Materials User Facility at Argonne National Laboratory. M. K. and K. M. R. acknowledge support from Office of Naval Research grant N00014-12-1-1040. This research used resources of the Advanced Photon Source, a U.S. Department of Energy (DOE) Office of Science User Facility operated for the DOE Office of Science by Argonne National Laboratory under Contract No. DE-AC02-06CH11357. M.G.K. acknowledges a Samsung Scholarship from the Samsung Foundation of Culture.

2017-12416  |  INT/EXT  |  Newsroom